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^ This workbook is designeA' to build or improve the 
basic planning skills "ne^Sed by persons responsible, for program 
planning in alcohol service agencies.. An understanding of the generic 
planning process in the developjnent , or- expansion cf community 
alcoholism-i^ealted services carf^be acguirad through the use* of this 
•guide. The workbook attempts to -Ife'ad -partici{)an.ts tq^def ine and 
identify examples of all four coi^c^ents' in the planning- process ; 
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a*ssessm-^n t> program design, implemeat ation, 
;i^:orkJbook *also 'leads participants* to use tlie* planning process on a 
given cb1aa unlit y problem within a simulatd community. This 6kill i. 



evaluation. The 

A 

.ty. This 6kill is 

th-^fr*appLied\^p an action plan for a problem area identified in ^ 
advance by thepart icipant. (Author/PJC) ^ - 
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Purpose: 
Goab: 



Caamt Maw' » < \ 



1, 



Participant 
Prcrequisfte: 



To build or impirove the basic piaarnimg skills needed by persemsispoi 
^planning in alc&hol service agencies. 
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ibie for prop^i*»Vn 

Participants will learn a^eneric prrogram planningiwwess anc lOTfy.itby developiiiaita pre- 
liminary plan for addre»ing a prcablem identified by the partiuoant^nd his/her suo-rvisor 
- prior to the training: program. i 

Participant Workbook is for use larticipants during*t}5fining and as a referenceJtserf^ward. 
For the trainer, the Partkipajt WannBoook is also a pripjacx^source in preparing tar-ji^'Mver 
of the program. U contains both ea«Bntial subjept md^ter anHlaSion exen;ises.' 

Trainer Manual includes background material for trainSF^reparation^ training prd«ram ijvaiui- 
tioa materials, and masters for •hamiouts and overhead transparencies to (je used ir _ne ccjin&i. 

^ Sessloh Outline Cards ^e U5edl)y tie trainer to guide.the preserltation'of each scj^ipn. Thisv 
provide concise covctmb of ' qL/estsons or points to be raised, as well as the sequence, time, 

f materials, and equipnsrr for ejch acrwity. They are compact and easyjto handle during 
course presentation. *^ \ 

this trainirfg prograrr. designee *or szaff • n existing^rvice agencies who are "^sponsibierc 
planning the developm^ t or c»P^jnsion of orograms responsive to community aicoholiisrr 
service needs. The audi«i«Ke fav tjais program could include either administratw/e or clmir-al 
staff whose effectivene^ deperal* upon acquisition or improvement of basic skills irrsysu^- 
matic planning for corr^- -lity ii< t^otism services, ii [ . ^ , 

The course looks at cCTTT?'-.^nin. 3r^^blems and suggests a framework for their resolution; It 
docs not deal with th»: lamirc cr organizational aspects of program development- 

As a prerequisite, each jaencant^jst sutmit an alcoholism service related problem' identified, 
in conjunction witfi hrifner supem-i^or. Work on application of planning skills to participant 
problems is the basis a: zne trairAg program, - ^ ^ , 
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nimning Alcoholism Services: A Basic Course in Assesi- 
rrmn. Program Desig^),implemer}tation,.arfri Evaluation 
wm. developed by The National Center for ArqohoKEdu- 
caipn in conjunction with a team of practicirtg ^po- 
hoAm cotAweiors and trainers employed by the Division 
, orr^lcoholism Drug Abuse, Wcst-Virginia Depipt- 
rrmM of Mental Hcafth, and by a private agency; fhe 

Virginia team specified the major activities and be- 
ha^r^ required for developing community progracns to 
exojnd or augment aJcoholisin servipes. These activities 
anot?«haviors were then verified by a sample of West 
Vinrroa counselors and supervisors as well as by a na- 
tionfcLS ^anel of prominent alcoholism counselors and* 
coufMor educators. These two groups identified the 
' neeu* ^r- community program development skills, al- 
thougt^ihey did not designate them as intrinsic to the 
counselor role, which the West VirginFa Division does. 
That 5»c-Sute of West Virginia-mandates that alco- 
iiolism cooinselors in its employ are to divide their time 
about ciauJIy between counseling and community pro- 
gram acswities. - ■ , - 

Among oie teaip and the panel members there was < * 
agreement that the possession of generic plahn1ng«kills^ 
was essential to the development and expansion of com- ' 
munity iucoholism services. Under the direction of Helen 
L K. Farr, Ph.D., project nrianager for the NationaJ, 
»Cbnter for Alcohol Education, center staff dr^ftQd ^ 
Pskiaaant Workbook containing basic reference infor- 
. matwr rm the planning process and exercises for the . 
traim^tf program, as well as a Trainer Manual containing 



a step-e^v-step guide for trainers ir ^^^sc in conducting the 
Icamirm activities. F^ollowmg revws in botn documents" 
based suggestions from the Vta: Virahiia team and 
three rwiewers working in or cl«Bfv related to com- 
munity alcoholism programs, thcrraifiing program was 
piim tnsted in West Virginia, Tenoessee, and Minnesota* 
The materials have been revised since the pilot test to re- 
flect »iuation findings, site observations, compients for 
trawBTs and participants, and three additional reviewers. 
One such revision was the preparation of Session Outline 
Cards te facilitate the trainer's delivery of sessions. 

Special acknowledgement is expressed hece to. the mem- 
bers of the W^t Virginia team, selected by Raymond E. 
Washington^ Director, Division on Alcoholism and Drug ' 
Abuse, West Virginia Department of Mental Health, for 
their contributtons to the development and pilot testing 
of Piaririfffg Aicoiiblism Services: a Basic Course In Assess- ^ 
ment, Progrann Design, I mplementatlor\^nd Evaluation: 

John Bianconi, M.S. 
Treatment Services Osordinator 
Alcoholism and Drug Abuse 
Division of Men taf Health 
• ' Charleston , / 

Jack^C.CIohan, Jr., M.A. 

State Training^Coordinator 

Alcoholism and Drug Abuse - 

Division of Mental Health 

Charleston • 



Charmaioe Ddomc 
Counselor 
Center oa Al 
Parkersbtirg 



M.S.W. 



and Drug Abuse 



Jierry Duckworsti, MJK. 
State Prevenavi\:3aordinator 
Alcohoiisivi aor J^tug Abuse 
Division of Mwai -Health 
Charleston i 

t 

G. Thomas f^ioer, BS. 
Coordinator 

Alcoholism ano Drug Abuse Program 
FMRS MentaJ Health Center 
^ Beckley 

. i 

Gerard J. Schmidt, M.A. 
Coordinator • ' 

Center on Alcomnnsm and Drug Abuse " 
'Clarksburg \ ^ 

Collett Smith, M.A. ! 
Coui^lor 

Centejp on Alcoholism and Driig Abuse 
Charleston 'i 

r 

and to the panel memiw^s who reviewed the actiyitles ^ 
and behaviors required for developing commL-nity pro-; ^ 
grams to expand or augment alcoholism services. 

L Sherilyn Cormier, Ph.D/ ^' 
Associate Professor , ^ 
Department of Counseling and Gu^ance 
West Virginia University 

♦Fred Davis, ^ 
Alcoholism Program Manager ^ 
Roy LittJejohn Associates,^ nc. ^ ^ 

Gloria 6oran, M.H,Sc. 

Training Specialist 

Regional Training Program for 

Alcoholism Counselors 
The Johns Hopkins University 

♦William Gideon, D.P.H. 
Professor of Alcoholism.Sciences 
Governors State University 

Norma B. Gluckstern, Ed.D. ^ 
Teani Leader, Health Care in Cojrrectiohal 

Institutions* 
University ftesearch Corporation 

« A. 

. .. 



Harold Hackney, Ed.D. . • ' 

Associate Professor of Couns^ing 
Counseling and Personnel Services > 

Department 
Purdue Universjty 

D. Corydon Hammond, Ph.D. 
Coordinator of Training and Research 
Afcoh^oTand Drug Abuse Clinic 
University Medical Center 
The yiiHversity of Utah 

Norman Kagan, Ph.D. 
' Professor *« . * 

Department of Counseling and Personnel- 

Service • * , . ^ 

J^ichigan State Universi^ 

Riley Regan, M.S,W. 
Director • , ■ ^ 

Division of Alcoholism 
*New Jersey Department of Health 

Chaim M. Rosenberg, M.D. 
Associate Pr^fessop of Psychiatry 
Boston ^iversity School of Medicine - 

Abraham M. Schneidmuhl, M.D. 
' Regi onal Tr aining' Program for 1^ 

Alcobofism Counselor^"^ 
The Johns Hopkins Unwerslty ^ , 

• ) ^^ ■ 
Gerald D. Shulman, M.A. 

Vice Resident 0f Chit Chat 

Foundation and Executive Director 
of -dhit Chat Farms and Caron ♦ 
Hospital • ' 

Wernersville, Pennsylwiia 

Jesstf E. TroW,Mtf.H-^ r 

Executive Director 
Program on Alcohol and Drtig Abuse 
• New Hampshire ^ % ' 

TheiNationaJ^Center for Alcohol Education extends its 
appreciatiork to the first draft reviewers of the Partici; 
pant Workbook and Trainer Manual: 
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Janiel^^ I. Davidson, B.A., B.D. • 
Executive Director ^ 
Alcoholisnrr Council of Greater 
Los Angeles^ ^ ;i 
^ Los Angeles, California ^ 

■ s ■ . ■ 



Donald F^odwiryM Fd. 
Chief, OcojpationaJ Branch 
Division orf Spcdai Treatment 
, and Retiabiiitation 



'National \mst\xut& or Alcohol Abuse 
and Akoholisr- 

Rockville, Mapvlanc 

.J 

Laura E. Root, M-S.W., A.C.S.w! , 

Co-Director - 

National Alcoholism Training Program 

for Alcoholism Professionals *^ # 
The Social Scie?ice Institute o j ' ^ 
Washington University j," ^: 

St. Louis, Missour i 

Gilbert Shaw, , 

Chief, Special P-ojects Branch 

Division of SpeciaJ Treatment 

and Rehabi! 'ation ^ 
National Instiintu; on AHcohol Abuse 
and Alcohofem J ' 

Rockville, Mar* and% ^ 
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Sandra Werncf. Ensign 
^.S. Pojblic Heaith Service 
Special Analysis Branch ^ ' 
/Division ofSpecial Treatment 

and ^Hgilitation 
Natior^^iifjjultute on Alcohol Abuse 
and AJcbholism ^ ^ 
Rockville, Maryland 

Ronald D. Wynne, Ph.D. 
Wj^nne Associates 
Washington, D.C. 



and to the pilot test trainers in Tennesse^ and-!^ 



*><::arol Berz, M.S.W. ^ 

^ * Administrative Director 

Joe Johnson, Jj-.f Mental Health Center \ 
Chattanooga, Tennessee 

Donald Devens, M.Div. 
^ Training Coordinator 

Chemical Dependency Division 
State Department of Public Welfare 
Saint Paul, Minnesota ^ 

)ohn Selstad, B.A. 
Supervisor ^ ^ 

*>Program Development Section 
Chemical Dependency Division ^ 
State Department of Public Welfare 
Sairit Paul, Minnesota 

Murphy Thomas, Ph.D. ; * 
Director ' . 

Rutherford County Guidance Center 
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"^IliottWard, Ph.D. 
Director ^ ] - 

Alcohol and Drug Abuse Sectjon 
State Department of Mental Health 
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Ining Program 
Overview 



1 



Training Program Goals 

The participar\ts will understand and be able ta;^ply 
a generic plartl^jng process in the development oVexpan- 
sion 6f community alcoh<jl ism-related services J v 

By the completion of the training program, participants 
will be able to: 

>^ ■ • 
^ • define and identify examples of all (our com- 
^ ^ ponen'tirin the planning procra; i.e., ass^jsrmint, 
program design, implemenution, and 
evaluation; ^ 

* , 

• define and identify examples of all the major 
^ t activities in^each of the four components pf 

the planntng process; .' N 

•yuse the planjllng process oiTa given coKl^unity 
^ problem wrmin a simulated community; and 

• apply the planning process skills covered in thj>. 
training program Id an action plan for a problem 
area identified in advance by the participant 
artd higher supervisor. 

Session One: Introduction *and Welcomje 

Syikpsis: An atmosphere is established to foster 
learning by providing an oppdiptunity for the!participants 
art^ training staff to-be^orri^ acc^^uamted. Participants 
will becgme familiar with the goals', objectives, content. 



and sequence of the training progra^m and begin to ex- 
plore how a plannin^process can assist them in develop- 
ing alcoholism services. (Training program evajuation 
dau may also Bl^athered.) ' * , 

Objectives: Participants -will: i 

• become familial- with the purposes and ob/ec- ' 
tives training program, and 

* establish a workable accommodation between 
their expectations and wHat is being affered 

in the training program. ' . ' 

/ 

Session Two: Planning and Community ' * 
Irjyolvement - 

Synapsis: This session focuses on the impor^nce of 
ihvolviij' various segments of ie communit^' in plan^ 
rnng for the development or expansion of iHtoholisnr 
services. A list of the major activities by w'hich^a 
planner can further such involvShient is presented fot 
review by the participants. Afte^a br^ef considerilion ^' 
of which activities might apply t^o .their back homfe^ 
. {problems, the participanft^^name the kinds of individuals 
'and groups they expect ^ involve in working on their v 
problems. As an-outcome of thisj^activi^y, fhe use of the • 
term- "community" as the context foi*exercises in this- 
trainfhg progranartS' clarified. JFirjally, thV participants ' 
perform the Brolcen Sqaare^ exercise, which illujyates 
in an experiential way the importance of coordinating ^ 
resources in a tiean^ or community effort. , j> ^ 



A 




Objectives: Participants will: 

identify two essential reasons for being aware 
of the community when planning for aico-. 
holism services; 

^ -% • • (ute^at least two common difflcul'ties Jn eliouing 
community cooperation on alcoholism service • 
j ^ programs; • ^ \ 

• list at least threejcinds of Individuals or groups 
,4n the community they will probably want to* 
work with on activities to establish or expand 
alcoholisnl services; and 

^ • specify^ cKjcial ingredient for malctng certain 
that nepessary communfty resources are used 
both effectively and efficiently. 

Session Three: AssessAient: Stating the Problem 



C 



te 



- Synopsis: TfTis session provides participants wi^tlTan over- 
lew of all the fnajo^ steps involved in i:arrying out a sys- 
tematic needs assessm^^t^^rticipants are introducecl to 
a detailecTdesZrip^on of the first major step in commun- 
ity assessment: identifying and describing a problem/in « 
a concise problem statement. They apply what-ib*/ * 
haveldarned hif writ^jig problem statements related to a ' 
simulated community situation, and to the "back home . 
problem" they brought t^ the "training program. ^ 

Obiecti^es: Pa'rticfpants will: ' ' " , 



given a possibleproblem area from a simulated 
community, ap Jly the first majdr step of a 
Heeds assessmem to identify in cjear an\j45re- 
cise langyage^ least one specific and disttnct 
problem iiVuie f^ssibje problem area; and 

apply thf session learnings to their back home 
probi^n 



Session Four: Ussessment: Collecting Data ^ 
About.the Probljem 

^ ^ \ . 

Synopsis: Session rWir helps ^he participants under- 

. -^nd and carry ou^ tn^^cond major step in assessment, 

Collecting data about ^ specific problem. Participants 

will focus on the kihds^of 4nformation needed to deter- 

minoi^he extent of the problem (s) and on ways to 

identify sources 4om which^the information can be 

extracted. , ^ 

Objeaives: Participants wilJlT^ 

des<jribe' the kinds of data requ^ed-to ade- 
. quat^ address a specific problem; ^ 
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• identify kinds^f sou.rceifrom which"^^ infor- 
mation can be extracted; and 

spell out ways the needed inform 
be^collected. . . ^ 

Scfssion Five: Assessm^t: ^nafyzmg the Data 

Synopsis: This session complet^ wopk on the assess- 
ment ^opponent of the planning process an^f marks the 
transition to the second component, progrih} design. ' ' 

Participants learn how to analyze data from a simulated^ ' 
community so that jyoblems can be rapked and dealt 
with through decisive and cCordinatedtction. Partici- ^ 
panl^continue'to work on their back home problems. 

06/ecf/Ve5.- Participants will: ' 

. • list three necessary steps in anal^zTng the col- 
lected data; and * 

• identify at leasL^hree bases for^setting priorities v 
and making^ecisions about problems. 

Ses^onSix: Program Design :-5etting Goals'^ 

Synopsis:^ This session introduces the program design ^ 
component of the planning process. Participants \ 
learn how to formulate goal statemenft that are respon- 
sive to the need(s) ©f the target group identified during 
the assessment phase^nd selected for action. rSeses- ' 
sion emphasizes that goals are outcome or result sUte- 
ments and not activity statements. It lays the ground- 
^work for th^ specification of concrete program ^ 
objectives. ^ ' i ^ ' 

Objectives: Participants- will: ^ 

• 'given problem statements ijased on the^simu- ^ 

lated community, write goal statemehts accord- . 
ing to ^r^ining program criteria; and - . .\^ 

Vite a goal statement responsive ta their back * 
home problem statements as formula'ted in thfe 
/ ' . assessment sessionsr^ . * ' . 

Session SevertyProgi;am Design: Specification 
ofjObjectiVes * 

jSynopsis: In the previous session, participants learned 
hqw to formulat^well writte^^oal statements for a 
program addressing an identified need. In this session, 
they^work at making these outcome statements spe- 
cific, time-phased, anti measurable. When properly ^ « 
formulated, program objecti;*es provide the bases fpr ^ • 
evaluating the degree to which a program goes accord- 
ing to plan. > ' ^ 

<^ *. . ^ 
ft , m . ^ 



'Obj€tctfve$: Participants will: ^ ■/' ^ 

M^j^dcniify t^^our essential cfements of a pro- 
/ gram objective using the criteria provided In the 
I ' training pi'^Tun; ^ ^ 

• gK(^ a sample goal statement, write prcpdxft 
^ objectives using the /our criteria; and / 

' • write aji^ogr^np^^jective for their^ back home 
/ problems: 

Session Eight:, Program*Desiin: Choosing 
a Str at egy ♦ * * . 

Synopsis: This session provi4es amodekto help partici- 
pants choose a strategy for carrying out the program ob- 
jective(s). Participants focus fipt on identifying possible 
strategies; next on choosing the strategy «that will acco/n- 
plish the objective^with the fewest or least important 
undesirable side effects; and then on identifying the ^ 
resources necessary to carry out the strategy choserL- 

Objectives: Part^ipants will: 

• ^piy the four basic steps provided by the 
^training program in choosing a strategy>'and 

• complete an Agency and Community Resource 
^ Inventory. / , ' - 



Session Nine: Program Design: Time^Phased 
Actipn Plan ^ 

Synapsis: A time-phased action plail spells out the 
tasks related to each activity needeci to carry out the: 
se4ected strategy; the order, phasing scheikile; and 
coordination of tasks; and the person(s) responsible for 
carryTng~oiitj^ach one. This sessioa teaches participants 
an easy method of going from ^ selected strategy and 
resource inventqry tQ a detailed performance plan. ^ 

Objectives: fti^ticrpants wilh^ * . 

% flevelop a timf-pjiased-adion plan ,tac^rcy 
o^t one of .the major activities ne^lSSht for 
implementing a selected strategy. 

SessidnTen: Implementation: Wogram ^ 
Management and Coordination ' ) ' I 

5^/7op5/s: This session is ciesigned to allow the.plahner 
to explore some managem^ skills used in imple- 
menting a community program and to explore the ; 
importance of ^tabtishing and using Information ex- ' 
charige channels to keep all participating parties in- 
fofmed on t^e progress of an es^lished plan. The on- 
gqing role of evaluation and revision is aiso discussed. , 



Objectives: JParticipants wilj be able to: 



• 'describe several management skills thaf can 
assist them in Implementing a planned pro-^ 
gram; and 

• describe an inforni^tidn exchange channel that 
* cm be used takeep participating parties in* 

f^ji[med on the progress of an established plan. 

. Session Eleven: Program Evaluation 

Synopsis: This session focuses the^articipants' atten- 
tion on the qe^ for conducting an evaluation of tfie 
program developed. It brings 'together many activities 
that were considered in earlier sessions and shows how 
they^elate to and contribute to the evaluation effort 
Suggested techniques for conducting informal, indirec^ 
or process evaluation SrejOffered along with guidelines 
for selecting an evaluator to assist in the design and - 
execution of their back home evaluation effort 



^ Objective^ Particip 
• identi 




• complete an eval 



f program evaluation; 
approaches to pro- 



jvadiness checklist; 



tivity 



^ee uep 

of tll^l 



r evaluation elFfort; and 



list three planning activities that would contribute 
to;Jthrf effeciveness of their pro-am evaluation 



Se^ion Twelve:- Completion of Preliminary 
"Plan for Back Home Problem 

Synopsis^sAfter brief summarizirfg discussion of th 
planning process, participants will workjndividuall^ on ' 
their preliminary p|arj>f6r their back home problems, with 
;^iinalopp^aunity toask for distance from the trainers. 
\ty will then discus^ thefr planning problems as agroup 
1 identify a helping network for future contacts: 

Objectfve: Participants will: . . ^ . 

^ •^ complete their preliminary or partial plans 
? for attafcking their back home problems. ; 



list one advantage andone disadvantage for each 
data^thf ring technique Ascribed in the session; 

list three advantages.^d three disadvantages 
of using an outside evalu^or; 

complete, a set of^eyalyation worksheets for 
one objective of their back home problems; 

listth^ee ^ps that would increase th'e objec- 



Intrbduction 
and 




; Session 



Synopsis: An atmosphere is established to foster learn- ^ 
ing by providing an opportunity for the participants and 
training staff to become acquainted. Participant$ will 
become familiar with the goals, objectives, content, and 
sequence of the training program and t^egin to explore 
how a planning process can assist them in developing 
alcoholism servi^s. (Train ihg program evaluation data 
may also be gathered.) 



Objectives; 



lectives;'^ Participants wil 



• become familiar with the purposes and objec- 
tives of the training program; and 

. / . 

• establish a workable accommodation between 

their expectations and what is being offered in ' 
the training program. ^; 

Reference Information: APIE Definitions ;..../ 10 
Worksheet 1 : Training Program Expectati6ns .... 11 
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-^APIE Definitions 



A planning process is a systematic way of making deci- 
sionis and taking action to address probienjis, needs, and 
concerns. It includes the collection and analysis Ofin- 
formation; specification of goals; and organization of 
resources. It culminates in the implementation of 
Planned actions and the ev^uation of the outcome' of 
those actions. The planning process is composed of 
• four overlapping and interdependent components: 
Assessment, Program DeHgn, Implementation, and 
Evaluation. The processfcan be visualized as a figure 
composed of four distinct but interlocked circles (see 
diagram below). Each component comprises specific 
activities listed below. , . ' 




Assessment Component 



The assessment compipnent is the initial part of the plan- 
ning process in which the following activities ^ccur: 



Mentification of the problem area(s) 
Prelimina^ evaluation of possible problem 
area(s) 

Defipition/statement of the problem(s) 
CoMection of needs assessment data 
Analysis of needs assessment data ^ 
Setting priorities among the problem (s) 
Decision P<Jfnt: Decide whether 6r not to 
pursue solutions to the problem (s) 



Program De^igh Component ■ \ 

The program design component includes the following 
activities: . . 

■• ♦ / - . 

• Setting goal(s)' ^ 

• Specification o|-objective(s) 

'^Selection of strategy(s) for reaching objective(s) 

• Identification of resources and constraints 

• Rating the importance and impact of resources 
and constraints on the plan 

• Development of a time-phased plan which 
includes the enumeration of activities, per- 
sonnel, and other resources required for achiev- 
ing the objectives 

• Analysis of potential problem and contingency 
plan(s) 

• Outline of the evaluation design for measuring 
success of the plan 

Implementation Component 

In the implementation component, necessary knowledge, 
skills, and resources are applied in order to achieve the 
goals and objectives. The following are among thelic- ' 
tivities of the implementation component: 

• Management/monitdring/supervision; per- 
formance of assigned activities 

• Establishment andXJse of information-exchange 
^ channels 

• Coordination of participating resources 

• Making adjustments as required 



Evaluation Component 



The essential purpose of evaluation is to provide infor- 

tion for decisionmaking. The major activities 6f 
evaluation include: 

Clarification of decisiqns to be made 
Identificafion of the type(s) of information 
needed to make decisions 
Designing an|>carrying out a plan for collecting 
^at information 

Reporting conclusions from the analysis in a 
timely and useful manner 
Feeding back evaluation conclusions for con- 
sideration in revisi^l the plan 



■ ■ ■ . * 

. >, SESSION ONE 

r ^ ^ ' - WORKSHEET 1 

■ ^ ■ ■ ' , • . . •• ^ V ■ • ' ■ • ' 

^ " •< ■ .. - •. • .' " • ■ 

Training Program Expectations 

^ Take about ffve minutes.to write down: ^ 

1 . Th^omfnunity programF^jafanning problem area that you have come prepared to work on during this training * 
pro^n^. (For the remainder of the training program this will be referred to as your "back home problem.") 

. ^ . •:. 



2. The aspect(s) of a planning process that interests or concerns you most in relation to this problem. 



Z. Your general expectations about the progrand (i.e., what you hope will happen during the program, what you hope 
to gain). ' * " 



-1/ 



f ' ' ' . ■ ■ 

4. Your worst fears about the training program (i.e., what you hope will not happen). 
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Synopsis: This session focuses on the importance of . 
invdiving various segments of the community in planning 
for the development or expansion of alcoholism services. 
'A list ot the major activities by which a planner can 
/further such involvement Is presented for review by the 
\participant5. Aft^r a brief consideration of which activi- 
ties might apply to their back home problems, the par- 
ticipants name the kinds of individuals and groups they 
c^jcpect to involve in working on their problems. As an^ 

I outcome of this activity, the use of the terpi "commun- 
ity" as the cootextcfor exercises in this training program 
'is clarified. Finally, the participants perform the Broken 

^ Squares exercise, which illustrates In an experiential Way 
the importance of coordinating resources in a team or 
community effort. * . 



Objectives: (Participants will: 

• identify two essential reasons for being aware 
of the community when planning for alcoholism 
services; ; • 



cite at least two common difficulties in eliciting 
community cooperation on alcoholism service 
programs; 

• list at kast three kinds of individuals or groups 
in the community they will probably want to 
work with on activities to establish or expand 
alcoholism services; and 

• specify a crucial ingredient for making c^^tain 
that necessary community resources ajflj|sed 

• both effectively an3 efficiently. ^ 

Reference Information: Community as Context 
for Planning the Development or Expan- 
sion of Alcol^e sm Services 14 

Workslieetxl : ActivjjBies Leading to CopMfiunity 
Involvement in Developing Alconolism 
Services / ^ 15 

Worksheet 2: Identification of Qommunity 
Individuals and Groups Relevant to 
Alcoholism Planning. . . . . 16 
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' REFEREISICE INFORMATjON 

Community as Context for^lannmg 
the Development or Expansion of 
Alcpholism Services 



Plannrng for the provision of alcoholism services does 
not occur \n a vacuum. No matter what services, are - 
ettvisioned, they must be planned in the context of 
the community m which they occur, 

^ ■ ■ ■ ' 
Community is a word with several meanings. In dis- 
cussing alcoholism service programs one community 
includes the people who will be served, both directfy^ 
and indirectly. This community includes Jteoholic 
cfienis, their families aad friends, coworkers and em- 
ployers, and ultimately everyone who may be affected 
by^the results of alcohol abuse,. ^ 

Af>6iher community includes those who serve, the 
direct providers of alcoholism treatment and providers 
of other services, needed by alcoholic clients and their 

■ / V ■ 



lied tfrerei 



amilies. This might also be called thr^ resource com-j 
Tiunity, which is already providing, o? could be mor 
bilized to provide, services or other resources (money, 
equipment, personnel, expei^se, etc.) to contribute 
to an aJcoholism service program. ^ - . 

^ ' ^ ' * 

In the^planning process, both of t^ese "communities* 
become resources. The community to be served must 
* be assessed and may bWome consultants in a plan to 
develop alcoholism services. Service providers must 
be considered in order to avoid duplication of services 
and to capitalize on possible coopi^ration and coordi- 
nation of services. ^ 

Viewing alcoholism service programs in their commun- 
ity context(s) benefits both alcoholic clients and other 
I direct victims of alcoholism aW the community as a 
whole. It helps to bring those^hb need services into 
contact with them as quickly as i)ossibfc, and it helps 
the cemmunity to avoid the wasteful expense of 
duplicate resource^or "services., 



c 




'^Actlvlticsf Leading 
' Conf^munity Involvement in ^ 
Developfng AlcohoUsm Services 

\ ■ '■ ■ ■ ■ ■ ■ 

Activities that lead to or are part of community involve- 
merit in the development or expansipn of alcofiolism » 
service progj^amsTnclude the follovying: 

* • 

1 . Periodically assessing or reassessing the totaf com- 
munity neeitfor alcoholism services, f ^ 

> ■ . • J 

2. Periodic4ly evaluating the total effect of alUvail- 

able services in meeting' alcoholi^.needi of the 
community as a whole. J ' / 

' i I 

3. Dividing targer commum'ty into tametgfoup^ con- 
sisting of specific populations for the developjnent- 

* = of alcoholism services. ' ^ 

4. Encouraging community groups and organizations 
to develop new alcoholism services where needed. 

5. Urgingcommunity groups and-organizations to 
expand their present level of alcohoj-related serv- 
ices as needed. 
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Promoting cooperation of othVr social agencies 
which are diretftly of indirectly-involibd with 
agen^' clients. * / ^ 

7,^^romoting the gcuds and positive image of the 
agency or organizational program in the specific 
community which it serves. •^' ^ ^ 



8. 



9. 



10. 



Training the staff and volunteers of community - 
■^agencies in ido^tification and 'referral of persons • 
with problem^ related to alcoj^l. ^ 

Promoting.the concept4i£xehabilitatic3n of profilem 
drinkers when talking or working with uninformed 
individuals, group's, and organization^. 

Initiating support forprimary prevention efforts 
in the community. 



I foi^convenie 



NOTE:' ^^l^bers are used foij convenience in reference 
ortly^ 'They do not indicate sequence or Tanking. 
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Identification of Community Individuals and Groups 
Relevant to. Alcoholism Service Planning 



In the context of planning alcoholism services that are 
relevant'to the target group to be served and that make 
use ofall available cdmmunity resources-.'tffst the kinds 
of individuals and organizatiorls in youf'community 
that you think it will be useful to work with in planning 



the development or expansion of alcoholism services 
relate^ to your "bagk home" problem, jftid make.i bMef 
note about their possible roles (e.g. ne*eds assessor, - 
service provider, service recipient, etc^) • 



FRir 
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Kind of Individual or Organization ' ^ 

■ * ■ 


1. 
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Synopsis: This session provides participants witb an \. 
overview of all the major steps involved in carrying out 
a systematic needs assessment, l^^rticipants are Intro- 
duced to a detailed description of the first major step in y 
community assessment: identifying and describing a ^ 
problem in a concise problem statement. The^ apply, 
what they have learned by writing problem statements 
' related to a simulated communitv situation, and-to the 
"back home problem" they brought to the training 
program. . 

Objectives: Participants will: \ 

• given a possible problem uirca ' simulated 

community, apply the first r s ^-o of a 
needs assessment to identify and pre- 



cise language at least one specific ana distinct 
problem in the possible problem area; and 

apply the session learnings to their back home 
.pi^oblem. 



Reference Information: The Assessment 

- *Proce*ss 18 

Reference Information: Stating the Probtem . . 20 

Worksheet'l : Formulating a Problem 

Statement 23 

Worksheet ^: ReS^iew of Back Home 

Problem Statement . 25 

• • ■ 
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em Process 



Assessm^^^HI foundatfon or groundwork on which 
alj succa^^^P>gram planning, Is^as^. A systematic 
needs ajMIWPt compj-iys the very beginning tasl<s,in 
planning/ As a result of the^scssme^ x!t\B program • . 
^j^anner is in a posftion to decide whether of not to pro- 
^Aeed with tht planning process. 

Two-representations of the planning process are 
shown in Figure 1. AssessmentlTorms the ba^e of the 
pyramid with the other activities positioned secufely 
on this foundation. The inverted triangle shows the 
planning process as it often occurs. In this case the 
program is based on an inadequate assessment, giving 
instability to the project andyequiriog an excessive 
expenditure of effort on evaluation. This j^eased 
emphasis on the later stages results because the incbm- 
plete needs assessment leaves goals and expected out- 
comes unclear; therefore, evaluation becomes a diffjcuLt, 
if ^ot impossible, task. 



Evaluation 

Implementation 




Program Design 
Assessment 




IDEAL MODEL 



FREQUENT MODEL 



Assessment is crucial and-must be done carefully and 
completely, because it directly impacts all of the subse- 
quent compcjn^ts of a planning process. Only after a 
decision has been made, on^he basis of the assessment 
activities and data, does the community planner: 

• formmate goals and objectives; and 

• pro^d with the development of a program 
design. 

By the time the assessment component activities are 
completed, a community planner will have: 

• identified and defined yht possible and the 
actual problem (s) that confront the 
community; ' 

• ranked the problems in the order of their im- 
' portance and their potential for solution; and 

• dedfled which problem(s) will be worked on. 



\ 



Asse^ent Activities 



The activities oYta^^involveli^'the a^sessmenfc^- 
poneni ^ tiie plannmg process are%h<iwn,in Figure'2. 

.NEEDS ASSESSMEffT PRCXJESST 

Vl<tehtify*a^ evaluate, po . 
problem areas 

Vwdte problem statements 

• Collect and ^nalyze ne^s 
assessment data 

• Set Driorities among problSrns^ 

^ • Decide whether or not to pursue 
* solutions ^ 

Each of these tasks or phases of>the assessment process 
is briefly discussed'below. \ ' 

1. Definition of Major Problems: Developmentof *- 
community programs begins with identification 
o^ those conmi^unity concerns that constitute 
actual pfoBJems. The following activities are in- 
volved in the selel:tion of program-type problems 
frorr community issues or alleged needs. 



a. ic3gntification of Po ssible P rflblgfn Areas: Pos- 
$ -^le problem areas are usually first identified 

t J planner through an administrative direc- 
t .a news* event, or some community concern 
^ trjL cafis for action. ^Sometimes, the program 
□eveioper initiates an^ction through investiga- 
tion of relevant situations/condition's in the 
community. 

b. Prelimihary Evahjation of Possible Problem 
Areas: On the basis a "quick-and-dirty" or 
"eyebair* inspection, a planner decides whether 
given possible problem areas .warran^ further 
attention. 

c. Definition/SUtement of the Community's 
Problems: Next, pr6blem definitions.are de- 
veloped by stating them in terms of who, what, 
how, and when, thus narrowing ^nd sharpening - 
the focus. 

Collection of Needs Assessment DaU: Assessment 
data provide information about the scope and im- 
portance of the probjjjfij- wi-thirfthe community: 
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Data^suall^ e^ist in many places*and in^many 
forms, and ihey mustte collected systp<|iaticaljy 
care^^ for an orderly exafmia^tw)n^i» 

V Anal)^ of N^s Assessment Datarffhe collected 
\ information is examined carefully and thoroughly*"? 
A number of different analytical methods cm be 
used to determine what the data reveal about the 
Community's actual need^. . s> . 

Setting friorities Among Wentified Problems: 
Once problems have been clearly stated and docu- 
mented, planners have to selebt which problem to 
work on first, which second, etc., since it is almost 
never possible to work on ail of tjiem at once. 
TlT(is selection process requires setting priorities, or 
rarlking. Decisions may be made on the basis of 
ht)w serious or important the problem is judged to 
be and/or on whether or not a problem cao-be 
solved or reducec, regardless of its importance. 



5. 'Decisions:. F^inally, the as^sshcnt component o? ' 
a planning proces? is completed when, using 4[tt2)f^^ 
the information gen^r^ted and studijed during the 
'm^jor«assessment activities just outlined, a deci- 
sion is made on whether or not to pursue 3 solu« - 
tion to afty of the StateJ!troWcras. Wz decision 
is mj^^e to work on a solution to one or more prob- 
) I'ems, the program devejoper/planner begins activi- 
^ ties in the program desi^ component^The prob- 
lems not selected for action are.di^r^ed or post\ ' 
poned for future cofisideraijon. 



Each of these activities is explained in^reater'de- 
^il below and in the next two se^ions. The focus, 
of this session, the activities reqmr'ed to define 
majoj: problems, are described in the following ^ 
paragraphs. 
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^Staring the Problem . 

\ To plajj/a solution-it is necessaryffti^ar^ with the identi- 

* J ^cation of the problem, but in planhingcservices for a 
A community, it isn't alwaysja^y to specifically pinpoint ^ 

X problems'Snd separate them fromjlKo^e needs that 
the community members think are problems'. Comfnuni- 
tjes ^re easily aVoused by shocking or tragic events whichr 

_^j^ay or rtiay qoJ be the outcome of an ongoing problem 
situation. On the other fjand, it may be difficult to 
aroose community members about a condition that is 
often concealed, such as alcoholism. 

i . ■ ' • ■ • 

In addition, communities often apply the label of ''prob- 
lem" to a broad topical area that is usually complex and 
vaguely stated/'Whwt is identified is really only a *'possi- 
bie problem area." Therefore, the community planner 
and concerned community representatives must nnfake a 
relativefy simple investigation of the pos*sible problem 
area to see (1) whether it is a real matter for concern in 
this cor -nunity and (2) whai actually might be the one 
. or nor '5^'c/7/cproZ?/^/775 in that possible problem area. 



This inv - >tigation and resulting decision constitute a 
"pr-llminary evaluation of a possible problem area." If 
the nianner decides that there are some identifiable 
proolems that are the proper*concerns of his or her 
agency, e- forts ire made to s|ate the problems concisely. 

-A rr >re detailed discussion of the first phase of the needs 
asse-smc process is presented be ow with explanations 
of: 



What a possible problem area.is and how it ' 
differs from a problem statement. 

• How to make a preliminary evaluation of the 
reality of the possible problem are^(s). 

• How concerns can be expressed as problem 
statements. 

" What is a possible problem area? 

A possible problem 'are* is a broad topical area that some* 
one, some group, or'some institution says is a problem. 
It is 5aid to cause; provoke, contribute to or be involved 
in some undesirable outcome. Examples of 'possible 
' problem areas include: cigarettes, smoking, lung cancer; 
a dangerous portion of a road, auto crashes; alcohol, 
•drinking, drunk dHving; theft, robbery, a section of town 
with a high crime rate, juvenile criminals,'st;reet murders, 
taverns, and child abuse. These examples illustrate the 
general characteristics of possible problem areas. They 



■' , . ^ ^ ■ / ' ^ ' \ 

obvioysly are broad, vague topics of concerji^ th^t may, i 
fact, enc^p^s-a whole set;<^f prol)lerris^that pften c&n- 
^ not be solN^Sfd betausfe of thei^S(^ope aa^complexity. 

* Why 4s the terrp^ossible problem arjea used? ^ 

'Often what is called a problei^i is too broad to beS 
true problem statement. Moreover, just tailing any 
concern a problemgdoesn't provide evidence tlj^at it^ 
^really^s one. In addition, sometimes people opiate 
with stereotyped reactions £o a label that may Be 
traditionally associated with trouble or difficulty of . 
sojne sort;-e;g., dark streets, gttns, the yo^ung, joy riding, 
drive-in movies. Thus, urttil fhe topiCihas been made 
more explicit and there is at least basic evidence that 
it is real, it is still only a possible problem are^i. 

How does a possible^problen? area get ^ « 
identified? 

Someone in the community or some event ordinarily 
calls attention to probhem are^fby labeling them as prob- 
lems. Identification and arousal of concern over a prob- 
lem often is the result of any one or any combination of 
the following: 

• An event or situation which arouses concern 
in the community, e.g., the injury or death of 
a prominent citizen or a group of young 
people. 

• A news or feature story on such an event or. 
situation. 

• The action, push, or '*clout" of a prominent, 
influential, or sympathy-evoking person or 
group, e.g., a powerful local citizen; the Cham- 
ber of Commerce; a political group; a service - 
club, etc. 

• The publicized opinion of a spokesperson for 
an official agency, institution, or similar office 
stating that it is a priority problem (e.g., NIAAA, 
State Alcoholism Authority, Council of Govern- 
ment, mayor, governor, etc.). 

. 

• A planner's own familiarity with community, 
situations or heeds. 

Why is the term possible problem area 
used instead of piro|t)lem? ^ 

lienti/ication of a possible problem area differs from the 
definition of a problem in a number of respects. For 



SESSION THREE 



REEERENCE INPOR^^ATION 



» 1 R'EEERENC 



^ exaipple, possible |*cJblciij arcasW Wually^brpad, gen 
. cral areas of concern that we" seldom bas^d on*^criticairy \ 
\^ ij^aminM evidence, but arc ofl^^ 

reactipn^anger^^ar, grte^ to ev^ts^cporte'd Jn^e 
.media or called tojattentioft through events that capture 
the synopathy of th«i[;ommumty.;in ^trast, ^blem 
definitions or problein statements are rathe;r narrow and 
sharp.vThey focus on ^specJfic troubfe brjiiffidUlty 
^rat^er than on emptional/stereotypic labels. 

Aow does a plainer make a prelimipary^ 
judgrrient abqiit the reality of ^5sible 
problem areas? > 

A program planner rhust make a preliminary judgment 
^ about which of the possible problem areas are real for 
W^l^r cornmunity. He/she should'not automatically 
assume that what is or was a problem at some time or 
iin another community i^ now a problem for his/her 
community. Wijhout much commitment of time, 
cffort,„oj:jnoney the commijnity planner can find out 
ho>v important a possible problem area is for hfs/her 
community by the following means: 

Asking those WfioTaentified the problem as 
such for evidence of its Existence. 
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Asking rhembers of other relevant agencies, ^ 
"organizations, groups for their views. 

Finding out^e status of the possible problem 
area in other, similar communities. 

Considering whether the authority and/or 
power 'of the pcxson or group that identified 
the "problem'' is such that it simply cannot 
be easily dismissed CHUgnored. 

Checking the literature related to the identified 
problem area. 



The kinds of evidence the planner should look for in- 
clude facts and figures >yhich show that trouble of some 
sort does or does not exist. The planner can get pre- 
liminary evidence^about the suspected problem through: 

• Official records and reports (e.g., police depart- 
ment, hospital, public health reports, school 
records).^ ?^ > . . ^ 

• The media (newspapers, television, national 
magazines). 

• People who interact regularly with th^entified 
problem group or activity (e.g., schoofperson- ' 



net, |iealth workers, recreation workers, bar- 
tenders, ^drivers). « • 

^ , , • ' Colleagues (plfone^lls, letters^ Inquiry, rc- 
poi'ts,^>rofessiorral journals). " , 

How does a planner know when he/she has. 
^ough reality evidence to Aiake a de'cisioh? 

) ,;. , ' * 

The planner can make a preliminary decision about the 
existence of a |5robJcmAvhen he/she and the concerned 
community members ire convipccd tJ^U^s (or prob- 
^ ably soon will be)/cattsing undesirabldfl|M^es in th^e 
community. Thfe preliminary evidence wil^iggest that 
for the persons in this community it is or is not a mof^ 
serioUs concern than ih other comp'arable^communities, 
or than it was previously jn this community. 

When the planner and the concerned community mem- 
bers can begin to view the prol)lem area frorn one or - 
• more narrower perspectives (e.g., notall "young people," 
^>ut "ydung people in a particular group who,do sorne 
particular thing") it usually indftyatesf tKat they have * 
ll^ntified a problem area tHat inclb^es a set of specific 
problems. ^ 



How does a problem statement differ from 
a possible problem area? 



From a breakdown and analysis of the possible<problem 
area the planner can derive a sharp and precis state- 
ment of a specific problem. Depending on the topic, 
the problem statement specifies as many of the follow- 
ing as are applicable: 

• Who is involved or affected. 

4 

• What is involved or affected or what happens, i 

• How the trouble or difficulty happens or mani- 
fests itself. 

• When or how often the 'difficulty occurs. 

• Where or under what conditions the trouble 
occurs. 

What is^ common error that is made in } 
stating a problem? 

Possible problem areas are usually presented and dis- 
cussed 6n the premise that "something ought to be done." 
It is easy ,^ therefore, to slip into the error of string the 
problem in tecnis of the solution.. For e)/aprpe7"l have " 
to go to the dentist," is really a solultioi^ro the problem. 
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^ have a toothache/' In the sanie way^^'R^ucmi /* ^ ' it is,then poiibte to^vesti^ate tho^spcclfic prob: ^ T^ '^ 

^.^It&hol-relafcd automobile crashes IP tKy^ . Jems moreOclosety. In otheM^ords,<latacan4*col-^V, " . 

"^^ ^ P^^^"^v " / V - ■^ctedtolJ|{j6tr^tetbcexte^^ 

• tiiil\* *J . — V^. . \*; • leni(s^ Thecolfection'crf^ecft^^ 

^ WM does a planner doVnce'the piidUblem. " ^ subject of Sdssion Four r ' ; ^ . v. 



• ^ . — ' \ . '^i • leTTHSf. Itie coiiccuun wnceab^scssr 

, WM docs a plannv doVncc^thc pr)dt>lcm object of Sdssion Four.p' : - > . 

Once a programy^lannfer has identified and Tjl^arly ' ' , * . 4/ ; - >^ 

stated one vQf more real problems for the community, ^ ' -r*-^ - i ^ ^. , ^ .T^ ' r** 
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'/amej Jo^ prominent Af IE* qitutq, died rVcently 
and left $N{.0()0 to the District Y Boasd of Dire<rtor5, 
with thfc stiph(«K)n that thje fund^ used ''tq^elp 
ijjve alcohol-rehited problenisam/Rg the'ejcJerly/''^ " 

A few>day$lftcr this bequest was rei^orted, the local^ 
new^papcrjJublished a feature story about the f^elL- 
ne$$ and isolation of elderly citizens in the community, 
including a man whols an alcoholic as one e;^imple. 
The same day, a special report on the public health 



■ \ 



status in Af ife County my tiafied dru^ jnt^ractiofr ptob- 
.l^ims as a growing health haza^'d, j^articularJy ^mong the , 

^-eldorly, who.&ke more prescription drugs than the , \ 
younger population 5ind may^tend to becor^^e confased, 

' about dosages. » ^ • v V^* ' " ' I ^ 

At the urging'of the'mayor, tl>e Board has asked your ^ ^ 
group, a'haqning Task Force^or Wstrl^t*Y, to qonvenc ^ " " 
immediately to select and recommend specific problems 
for whiph the bequest can be used. * Si ^ . 



Individu^^ask (15 minutes)* -^^ ' 

1. What issues should the Task Force consider in thhs j/iitial meeting? 



2. What kinds of actiorr would be rKcessarV" to reSolve the issues? 



■r ■ s 
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3. Whei^. could you go to get some needed information about.the elderly in APIE County? 



" Assuming that your Task Force identifies alcohol abuse among the elderly as a problem in the County, write as 
concisely as you, can in the space below, a specific problem statement in the possible problem'area selected; i.e., 
"alcbhol abuse 'among elderly people." If you turn to the reference information on parfes 18 to 22 in this 
workbook to review the characteristics of a problem sUtement - . 




Small Group Task (15 minutes) 



1. 
2- 
3. 



Each member in turn ref^<(sjiis or her problem statement 

The group sl^ould evaluate each ac^rding to whether or hot it identifies a specific, solvable problem. 

As a group; select a statement (rcwocding or combining parts of the .others if necessary) to present to the full 
grpup. (Be prepared to specify the criteria you used in selecting it) 



4. Write your selection on a flipchart and designate a group member to present it 



■ . -9 
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Review of Back Home Problem Statement 



N,ow that you have discussed the distinction between a^ 
possible problem area and a problem statement,' turn to 
your back home problem as you expressed it in Session 
One (Worksheet 1, page 1 1 ) and see whether it was ex- 
pressed as a clear problem statement. 

• Is it too vague or brbad to be addressed by an ^ 
agency and/or community program? Does it 
.need to be broken dowm further to identify a 
specific problem or problems within an area of 
' concern? 



Is it the statement of a solution rather than a 
problem? " 

Is it expressed in terms oi who is involved, 
y4}Qt happens, h6w the difficulty manifests it- 
^\i^hen ox howofteh it occurs, and where 
or under ^hat conditions it itappens? 



If necessary, restate the problem in the ipace below: 



•Session IV 



Assessment: 





about the Problem 



— y 



Synopsij^ Session Four helps the participants under- . ^ 
stand and carry out the second major step in assessment, 
collecting data about a specific problem. Pa!rticipants 
will focus on the .kinds of information needed to deter- 
mine the extent of the problem(s) ind on ways to iden- 
tify sources from which the information can be . 
extracted. ^ 

6biectiyes: 'Participant wni: 

• describe the kinds of data required to adequately 
address a specific problem; 

• jdentify kinds of sources from which thf infor- 
' ' niation can be extracted; and 



• spell out ways the needed information can best 
be collected. 

Reference information: Collection of Needs 

Assessmcfnt Data . 28 

Worksheet 1: Data Collection Planning 

Exercise * 30 

Worksheet 2: Planning Data Collection for > 

Back Home Problem . '. . . 32 
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ection of Needs Assessment Data 



After clear<ut problems have been sUtcd on the basis 
of a preliminary investigation and judgment about some 
possible problem area, a community developer or planner 
docs a more deUiled investigation of the key eleme^tW 
. in ^ch of the problem sUterocnts. That is, data are col- 
lected to determine the extent to which a given problenfi 
(or some aspect of it) exists in the confunuaity. This is 
Phase II of the needs assessment process. The data are 
collected so that later a decision can be made about 
whether or not to respond to the identified problem(s) 
or need(s). 

A 

What Is meant by data? 

Data are pieces of information asscmAd for examina- 
tion. Needs assessment data may incfude not only 
"facts and figures" but informatioi^bout attitudes, 
opinions, beliefs, activities, and e^nts as well. 

Given a problem statement, how does a planner 
determine what data are required for a 
needs;assessment? 

^ The planner first looks for the who, what, how, when, 
and where content'in the problem staternent to see wbat 
kinds of information figure in it 



He or she decides whether these kinds bf information con- 
sist of, or take their meanings from, other klpds of infor- 
mation. For example, take the problem statement, 
"Many professional persons arc not aware of the extent 
to which alcohol-relatcd problems affect the people for , 
whom they provide services." It maybe necessary to 
define what is meant by "many/* "professional pw>sbns," 
"aware." "extent," * 'alcohol -related problems," "affect," 
and "services." The planner must realistically determine 
what pieces of relevant, required information he/she can 
' col lecjf given existing time, staff, money, and access to 
the data. 

For whom is the needs assessment data 
tobe collected? Who will use the data? 

Most imynediately, the daU will probably be used by the 
planner or community planning group. Eventually, how- 
ever, the data may also be used by others, e.g., agency 
supervisors, Yunding bodies, and other persons or groups^ 
rcievanrto the problem(s) under assessment. 

The identification of all probable daU users shoutd be 
considered before beginning to collect data because all 



may not be satisfied with the same daU or with the 
same Ipvel of detail. For some, it may be sufficient 
rperdv to gather daU on whether a condition or event 
existytor has occurred. For others, it may be neces- 
sary to provide daU on how often, under what circum- 
staoces, with what results, at what costs, etc. 

Similarly, probable users may require different levels 
of precision. For example^ it may be enough for a 
teacher to determine by touch that a child has a fever; 
the school nurse seeks more precise data by using a 
thermometer. 

Likewise, reporting forms vary with the- kinds of data re- 
ported. 'A school principal might want a record 0 how 
many st;udents were absent from school each day* A 
public health officiaf might want to k<iow how many 
were absent due to illness, the diagnoses and duration of 
illness in each case, etc., so would need a mor^'complex 
recording format. 

For what purposes '^do the probable users 
need the data? How will the data be used? 

• to provide information or knowledge; 

• to make judgment possible; and 



to allow for sound^^cision rnak 




^ The end pcTintof the data-gathering actfc^itv^; in ^eedjr / 
assessment is decision rfiaking^ Decisions; ^^^r^ ^ 
result of judgments; judgnients aj^e bj^ 

' available. On the basis of the dati i^thcHK^ ne^ds 
assessment process, a decision is made'afiout Whether' or 
not the problem is one that the planner will work to . v^ 
resolve. 

Where does a planner get th^equired data? 

' '» • * 

Therq are two sources the planner can look to. One is^ 
"the horse's mouth," that is, the people, places, events, 
situations on which data are being collected. This is 
called primary data. , 

' ■ . ' * <i> 

What are the advantages of primary data? ' 

< . • ' ■ 

^ . • Primary data can be precisely tailored to answer 
specific questions about the problem at hand. 

• The planner has control over the scope and 
quality. , 

• They may add to the existing bank of informa- 
tion on the problem. 



\ 

• They may j^ovide "serendipity dau/' informa- 
tiorr beyond what was sou^t 
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What are the disadvantages of primary data? 

*• They fnay be costly in time, personnel, and 
other resources to compile. 

• Thiey may turn out to be of unceruin or limited 
usefulness, which may npt be discovered until the 
data have been collected and analyzed. 

Where ei^can the planner 
\6ok for required data? 

The planner can also look to sources other than those 
actually being investigated. These are called secondary 
dita. ' 

What are the advantages of secondary data? 

• Ttiey are usually cheaper,'^asier, and faster to 
collect 

...... w 

• They can iserve as a check on the validity of 
whatever primary data the plarxner may have 
collected on a problem. * ' 

• They may provide the onlymeans for getting 
Information on a particular problem. 

. ' \ • are nHich more coniplete than 

iy ' l'V^^ have gathered, given the con- 

' V , which he/she must operate. 

. .' ^ they may provide the planner with additional 
. 6r different slants on a problem. 

What are the disadvantages of secondary data? 

• They may rrdi be as complete or precise as* the 
\ planner needs. 

• Depending on how, when, and from whom ^ey 
were collected, the data may be faulty, inaccu- 

- ^ rate, biased, or out of date. 

■-^ • They may be slightly off target, since they may 
have been collected for another purpose. • 

How can primary data be collected? . 

' / _ ■ • ■ 

" IntormatioTi about the target group, situalion^^r event 
can be gathered through:- . ^ 

Interviews with the target group 
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• Questionnaires completed by target group 
members 

; • Observation of the target group ' 

1 • Surveys conducted among the target group 

How can secondary data be gathered? 

Secondary data can be gathered by collecting relevant 
information about the target group or situation from ' 
otner people or sources. Additional sources of secondary 
data are reports, studies, presentations, artic^j^etc., 
which other persons, agencies, organizations, or institu- 
tions may be able to contribute as a result of having 
gathered their own primary data on the target group, 
situition, or event. 

What are some of the pitfalls in collecting data? 

Collecting more dau than are heeded; whether 
I " too much of the same kind or too many kinds 
for the purposes.of the needs assessment 

Failing to collect data in an orderly, consistentj^ 
usable, and predetermined way. 

Failing to make sure^at data are collected in a 
i usable form, and are properly labeled as to 
\source and content 

Failing to check out the design of the data 
collection instrument(s) (e.g., questionnaire, 
survey form, etc.) to make sure it is appropriate 
in regard to 

A information sought, 

— linforrnation providers, 

— style and format, 

— vocabulary used, 

— ctirections, 

1 - ■ ■ 

— context or settmg for use, and 

— time and effort involved m supplying data. 



• Failing to revise instrumehts and/or procedures 
as necessary after a preliminary draft or trial 
run. 1 

• Failing |to offer clear and believable reasons for 
collectirig thie data. ' 

• Failing tip state appreciation to providers of d^ata. 
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Data Collectiohl Planning Exercise 



Write in th\5 space below iht problem statement that 
your smaJI group, a planhing task fduce in APIE County, 



wrote in Session Three as a result of considering the 
possible problem area of alcohol and the elderly. 



Your group taskis as follov 

' il ■ ■ * ^ 

• Select a recorder/reborter to list your responses a ' 
and report them to|pe entire group at the end 
of the exercise. 

• Brainstorm a list of the kinds of information 
your group will neecilin order to gain better in- 
sist into the stated problem. » 

il ' 

• From the brainstormmg list, select five kinds of 
information your grow considers to be most im- 
portant for assiessing tne stated pq)bl«m. List 
these on flipchart sheets, not more than two to 
a page to allow space for the additional infornna- 
tion requested below. 



• Under each of the five kinds of dab write:. 

— a short rationale of why it is important; 

— the probable users, their j)urposes, the level 
of detail they may require; 

— the co^affLmty sources from which e^h 
kind of data might be collected. (See pag^31 
for partial list of APJE community agencies 
as a string point.) ^ 



a procedure anr<J/or instrument to be used 
for extracting e^ach kind of data. 
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P^urtial List of Community Service Agencies in 
APIE County 

^ • ^ 
NOTE: Draw on your own experience and Imaginatiorr" 
in naming other resources li they are relevant to 
your problem, 

Al-Anon, Alateen, Alcoholics Anonymous ^ : 

Alcohol Safety Project (DWI School) ■ 
APIE County Medical Society 

City and County Court Systems ^ 
Gty and County Health Departments 
City and Counjty Social Services (Welfare) Departments ■ 
Community Action Agency 
Community Counseling Center ■ , 

Community Center for Drug Abuse Control 
Council of Churches-:^ — w ° 
County Nursing Home 
Gty and County. Police Departments 
Family Counseling Center 
-Florence Crittendon Home for Unwed Mothers 
Fire and Rescue Squad Departments 
' FISH (Friendly, Instantaneous, Sympafeietic Help) 

Volunteer Agency ' ^ 

Ford's Nurling Home t \/ ^ J 

Foster Parent Project ^ v ' . --^ 

Goodwill industries ^ 



Grey Pani(iers of APIE County 



Head Starf 

APIE County Hospital 
Housing Authority i 
Legal Aid Society 

Mental Health Association of APIE County >^ 
MenUl Health Clinic ^ 
Mentally Retarded Adults Training Center 

Mercy Mission, Inc. f'^^^^ " 
Open^^oor CommunityWouse 

Riverview Nursing Home ^ . . . , . 

Rpadmore Nursing Home ^ ' y 

' Sad vation Army ^ ^ ^ 

Senior Citizens Community Center I ' 

Social Security Administration ^ ^ . ' 

United Fund ' ^ 

University of APIE > 

Urban League , • * r% 

Training and Employment Services - 

Veterans Admin^ration ^ v'^ 

Voca[tional Rehabilitation Division 
Welfare and Child Support Recovery Unit 
Wilderness Nursing Home 
Women's Center (Volunteer Organization) 

YMCA, YWCA X 
Youth Opportunity Commission ^ I: 
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Planning Data Collection for Back-Home Problem 



Taking your ttack home problem statement, note for yourself whether any of the terms you used require /urther r 
definition. (See page 28 of reference material.) ^ ' - 



5 



Next, on the following two pages, list aJI the kinds of data you believe will be necessary in carrying out a needs assess- 
ment related to your problem statement. ^ 1 

List the probable users of the data you plan to collect - ^ . 

For each kind of information, list aJI the sources in your commuriity that you think could provide the data you require. 

Keeping in mind the probable users, their purposes, and the level of detail required, note tht procedures andjor types of 
instruments you might use to collect each kind of data. 

Be prepared to share ideas in a discussion with your small group. « > . ^ 
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Synopsis: This session completes work on the assess- 
ment component of the'pianning process and marks the 
transition to the sccopd component, program-design. 
Participants learn how to analyze data from a simulated 
community so that problems can be ranked and dealt 
• with through decisive and coordinated action. Partici- 
pants con tihuejto' work on their bacic home problems. 

Objectives: P«irticipants will: 

• list three necessary steps in analyzing the col- 
lected data, and 

• identify at fcn^t three bases for setting priorities 
and making decisions about problems. ^ 



Reference Information: Analyzing Data 

for Decisidns 38 

Worksheet 1 : Exercfse in Collecting and 

Analyzing Data Igm a Simulated 

Community ^ . ^ ............. i 42 

■ ^ , • \ . 

Reference Information: Guides for Setting 

Priorities and Making Decisions . . . . . 50 

. Worksheet 2: DaU Analysis and Decision- 
making Exercise . . . . 53 

Worksheets: Looking Ahead tQ Analyzing 

Data Back Home ......... ^. 54 
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AnaiyziiTg Data for Decisions 

Collected dau arc merely a jumble of information until 
they have been organized and analyzed for possible 
meanings. For mWiy community program planners, 
analysis of the^daU is the most challenging and exciting 
^of the assessment activities. Data analysis often calls' 
'Into play all of. the Ipgic and ingeTmi;^ that the planneir 
can draw pn.- It requires discipline, because the planner 
must never lose sight of the fact that he/she is sc^hing 
for evidence to support or refute the rteed to solve 
stateo problems. 

At the same time,, analysis requires more ^an a fittle 
flexibility and imagination.' ^ome years ago, a maga- 
zine ran a scries of -''Wliat-ls-lt?" puzzlesr The pictures 
. were all of common objects; the puzzle lay in the way 
they were photographed-ffom extremely close up, 
from unusual angles^r in unusual combinations. Col- 
lected data .can presWt the same kind of puzzle. By 
the time information has been collected, the planner 
is likely to be quite familiar with the dau but may not 
yet know mucfi about what they can reveal about the 
problem. 

Organizing and.reorganizing the collected daU to look 
at it in scarcf of different relationships, contrasts, 
trends, etc.,cis the ioitiai step. Then the dau usuafly 
begin to show where, with whom, .when, or with "what 
thefoCus of the sUted problem lies. 

What docs the term data analysis^ mean? 

DaG analysis essentially meahs examining individual 
pieces of information and identifying relationships 
among them so thar inferences or conclusions can be 
drawn. , - ' 
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reality was that there were fewer arrests because^ shortly 
after the campaign bejjn, all but a skeleton cr?w of 
police officers w^re diverted to special duty on a murder 
investigation. There were simply fewer police officers 
available' to arrest people for DWI. Fortunately, the • 
^ sheriff, who was on the council's board of directors 
pointed out this possible influence on the dau before 
the council director came to an incorrect conclusion - 
about the impact^ the drunk driving campaign. 

What is the basis, point of view, or J 
^ framework fpr data analysis? % 

The point of view uken in ^alyzing daU depend^^of 
course, on the fJurpose{s) for which the daU were col- 
lected as well as how the results of the analysis will be 
U5ed,^and by whom. Nevertheless, the following types 
of viewpoints are likely to shape the framework in which 
planners in an alcoholism service agency analyze daU:. 

• The Community: What might the dau show, 
mean, or imply for this Community? How 
might the information affect the community 



Who analyzes data? 



The planner will probably analyze the collected dau 
alone or^with the help of others involved in the planning 
p/ocess. He/she may have help from someone who spe- 
cializes in evaluation activities. It is desirable, however, 
for those who analyze the dau to be thoroughly familiar 
with the purposes^f the daU collection and also with the 
conditions under which the daU were colfectcd, in order 
to avoid false conclusions. For example^in one small 
city DWI arrests dropped*from an average of 31 per month 
to fewer than 10 per month during a cerUin period. This 
information led the local alcohol council director to as- 
sume that the council's new campaign on drunk driving 
had been immediately and fantastically successful. The 

38 



and vice versa?, 
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» The Program; How rjiight thedau/elate to 
this program? How might other-progrins be 
' affected by the information? Whatpro^m- ^ 
ming implications do the dau have? ' 

77?^ Planner or Planriing Group: Do the dau 
have any special signifiiSmce for planning activi- 
ties as they have traditionally been concJucted 
or are currently understood and projected? 

AlcoholHrelated Coricerns: Are thefe relations 
or implications in the dau that might be sig- 
nificant for alcohol use and abuse, alcoholism, 
and alcoholic persons? Might such concern 
^a^ influence or be some other yk^y involved 
or reflected in the^au that was collected? 
\^E.g., if there is a conspiracy of silence about 
alcoholism, dau showing a negligible incidence 
of the problem may not fcje accurate.) 

• The Agency: What implications do the dau 
have for this agency? For others? For this 
agency in relation to other agencies or groups * 
in the community? 

When dau are to be analyzed, it is wise also to review 
each portion of the information in terms of the who, 
what, where, how, and when of the problem sutement, 
as a guide in identifying the key frames of referende for 
the analysis. On occasion, thfe dau may reveal some 
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evidence that was unexpected but appears to be dam- 
. aging to the program or the agency. This can so jar 
and distract the analyst that the problem statement and 
the reasons for collecting the dau are forgotten, at least 
momentai;ily. Deliberately returning to the major topics 
in the problem statement refocuses on the task at hand 
and, sometimes, helps to put the damaging evidence 
into^proper and productive perspective. 

Similarly, the data analysis itself may suggest a frame of 
reference somewlnit different frpm those above. For 
instance, the cojlectedJn^ormalion may indicate that in 
a given'probl^m area, there may be far more serious 
or urgent problems than the ones stated. \f this hap- 
pens, |he planners should allow for consideration of the 
newty i^covere(J pro81em(s) and What might be done 
about theqfi at that point. Two ^ch possibilities are 
revisii^ or rewriting the problem statement(s) and ex- 
tending the data collection and analV^ to provide more . 
j^lJormatiorvon the new protJTem. 

Cireful problem.statement worl^ should make such a 
sKift in framework a rattjer rare occurrence; However, 
if thevieed.tQ restate does arise, it is silly to ignore it,r- 
■since uiis needs assessment data analysis is an activity) 
of the fir$t pfanning conrrponent— the front end work.* ^ 
After all, the purpose of a needs assessment is to finder 
' out what- is needed and/or how much it is needed. ^ ) 
However, if a shift seems necessary, under no circum- 
stances should the planner make the\hift without in- 
cluding the relevant community participants in the 
decision of whether or not to change from the original 
problem statement(s). 



How are data analyzed? What are some of 
the mechafnical activities in data analysis?' 



Ordinarily, the mechanical activities of data analysis 
seem to be left to on-the-job or experiential learning. 
There are, however, some simple practices that can 
enhance such learning. They are presented here to 
guide the novice analyst and serve as simple checklists 
or reminders for the more'experienced. 

• First^he^collected assessment dita are organ- 
izSfd^o that they are clear.and easy to read and 
study. For example: , ^ 

. — The same Idhds of information are grouped 
^ together- 

- Where it is useful, data are summarized, 
collapsed (I.e., combined), abstracted, etc. 



— , Certain kmds of data speak loudest to the 
analyst when portrayed in tables, graphs, 
charts, maps, diagrams, outlines— all of 
* which have a wide variety of forms, i. 

— whatever organizational method(s) are used, ^ 
greatyare must be uken to label accurately 

^andammediately eac)i unit or portion of the 
data; e,g., what it is, what time/place it came 
.from, who it represerits, etc. The importarice 
jpf ^correct labeling cannot be stressed too 
much. Given the reality of interruptiorts and 
other distractions, it is ver^-^easy ^o forget 
• whether the content of a given table repre- 
sents consecutive monAs or annual averages, 
.males, females, or both; the nortlvor south 
end of town, etc. . 

- ifiie analyst used coding of some sort, it is 
essential to record the coding key(s) on the 
data representation; e.g., blue=boys, black= 
girls; thick lities=the incidence in the north, 
thin lines=the incidence in the sout>i; dotted 
lirres=weekly totals, broken lines=monthlY. 

^ totals, etc. .[ , 

Second, each tabulation, representation, or 
grouping of data is searched for trends, patterns, 
peaks and valley^ similarities and differences. 

— Each group is examined to identify any pat- 
terns in the individua^l groups of data. 

— Patterns or relationships between different 
groups of data are sought and studied. 

- The patterns may convey their most impor- 
tant meaning when different kinds of data 
are examined together. For example, in ^ 
ceruin age or ethriic groups, neigh lArhbod, 
occupational groups, or economic levels, 
there may be mote or less evidence of some 
behavior, need, or difficultvUtian in others; 
or the occurrence of the behavia^^ needs, or 
difficulty variesamong groups depending on 
the time of year^ the unemployment rate, 
and/of the day of the week. 

' • . . 

- Data analysis as the tern? is used here includes 

data interpretatipn. It includes not on^^ 
what a cofuntn of figures or a report shows 
or says, but also possible explanations of ^ 
what4t.may indicate or meftn. Strictly 
speaking, "More boys than girls took part" 
is the stated result of analyzing some figures. 
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'This seems to indicate that boys were more 
interested than girls/' is one interpretation 
of those figures. Other interpretations 
could be: 

'There were more boys than girls avail- 
able to piarticipate/* / • 
"More>oys than girls knew they could . 
' take part/' / 
^ "Most girls had already taken part on 
previous trials/* and so on. 

\ - Om analysis should not be done in a hurry. 
"^The cautious planner allows for occasional 
breaks or time away from the data. In that 
w^y, when he/she returns to a study of the ' 
data, new relations and new interpretations 
may come to mind. Further, it allows for 
the verification or cprVection of previously 
identified relations and interpretations.- 

Third, the planner steps ba^k for an overall look 
It how the results of data analysis relate to the 
stated p^robtem(s) for which the data were 
gathered . ^ 

- The jnain question is whether the analyzed 

data support, contradict, or seem unrelated 
to the stated problem(s). 

- This overview involves integrating all the 
conclusions and interpretations arrived at so 
far, and provides the basis for the next assess- 
ment activity: setting priorities among, 
identified problems. 

- When the outcomes of data analysis seem 
contradictory or unrelated to the problem 
statemehls, the needs-assessment activities 
should not be seen as "wasted-effort" (unless 
it happens repeatedly, in which case the pre- 
liminary evaluation and/or problem state- 
ment Activities probably were not well done). 
The purpose of a needs assessment process 

is to find out in a systematic way what needs 
to be done; not to just "do an^sessmerit" 
and then push on toward "solving** a prob- 
. lem, regardless of what the investigation has 
revealed about the stated probiem and/or the 
need to solve it in that conimunity. For ex- 
ample, the suted problem niay be, "Selling • 
wine and beer in grocery stores leads to 
many serious car wrecl^ The assessment 
data may show that fiVe times as many 



^ serious wrecks occur between 11 p.m. an8l^^ 
3 a,m. (when grocery stores are closed) as x 
; occur between 8 a.m. and 9 p.m. (when gro- 
cery stores are open). 

When does data^analyiils begin: 

• Organization of the data can,begin as soon as 
all the data of one kind have been collected and 
identified as the sanrie kind of data; e.g., whdn 
all of the survey forms have been returned, each 
indi^al response can be tabulated on prede- 
signedlfeeorirForrh(s). 

- If the planner seeks help from an evaluation 
specialist about the design of the assessment 
instruments or procedures, it is also wis^ to 
ask, at that time for the specialist's advice > 
about how to record the dstta from the in- ^ 
struments or procedures. 

- After drafting the tabulation form for re- 
cording data, the'pianner should try it out'by 
recording thetdata from the triafruns of the 
instruments. Redesigning a form i^far easier 
and more economical than compensating for 
a defective one. 

• After each kind of data has been recorded, it 
can be reorganized in as many ways as promise 

0 to be helpful; e.g., data from all of the survey 
forms can be regrouped by sex, age, occupation, 
^ ' etc., of the Informants; all the interview data may 
be regrouped accofding to faVorable or unfavor- 
able responses, by geographic areas, etc. 

• Basic cautions in data ahalysis are against: 

- drawing premature conclusions or making 
interpretations on the basis of incomplete or 
incompletely analyzed data; and 

- discussing the data analysis findings while 
analysis is still in progress. Further aYialysis 
may change--or even rfeverse-prelimiriary 
trends, relationships, conclusions, and/or ^ 
interpretations. Lay people especially (i,e., 
community members) tend to not hear or 

to disregard the planner's qualifying words , 
when he/she says, "ffgltfninary analysis 
shows. . /' or "Initial data seem to indi- 
cate. . ." or "It begins to look as thoGgK. . 
Trying to explain the later reversal of a pre- 
mature interpretation or report can be very ^ 
painful. 
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How tan the planner know whether the 
needs assessment data analysis is 
as nearly (correct as it possibly can be? 



Only by taking every possibleH^irecaution and 
by exercising great diligence can a "correct" or 
accurate neMs assessment data analysis be 
approached. Resources for needs assessments 
are usualTy limited; therefore absolute. perfec- 
tion is rarely attained in "the real world" where 
''most planners work. On the other hand, the 
time for the quick and di^ty or eyeball analysis 
of data (done for the poss^le problem area) 
has passed. 

A planner can ma^e certain that the data analy- 
sis is as nearly correct as possible by: 

— exercisin|,great caution and attention to de- 
tails in each of the assessment activities as 
,they are carried out; 

— checking and.rechecking on accuracy at 
every step; 

— asking*questions about any piece or type of 
data which "doesn't make sense" or is par- 
ticularly surprising; e.g., a survey repord^ 
form labeled "Ninth Grade Boys" which 
shows an age range of 16-22 years;" - 

being alert to accurate but inconsistent or 
surprising data; e.g., th^ mentioned sudden 
/ drop in DWI arrests when few^ police offi- 
, cers were on the street; \ 



— asking evaluation speciafists or other quali* 
fied persons^ to review the planner's analysis, 
and in parti&lar his/her interpretations 
drawn from the assessment data; ^ • 

— comparing his/her flndings^with those from 
other similar investigations; 

— discarding faulty data when they ^endeati- 
^ fled as such;" e.g., correct directions were not 

given or followed; 

— collecting additional, comparable informa- 
tion to replace the faulty data (if possible); 



checking out assessment findings witK those 
who were investigated and/or who know the 
target group or subject Weft-; and 

— not extrapolating indiscriminately on the 
■^^basis of limited information. * 



Data analysis for any purposi^, but especially when it is 
done as part of a needs ^sessment, must rest on:the data 
being analyzed and interpreted, rather than on^-the prefer- 
ences, interests, or biases of the planner or evaluator. A 
dedsion to allocate limitqd resources on the basis pf 
slknted data aoalyses can only lead to future distrust in 
the comnriunity in which the planner or*planning group 
seeks support. The planning process allows for constant 
revision as new information is revealed. No one realis- 
tically expects that every problem investigated will prove 
to be what it.appeared to be before it was investigated. 
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Exercise in Collecting and Analyzing 
Data from a Simulated Community 

Directions: 

.1. Select a leader to guide your small group through 
this exercise and make a brjef presentation to the 
largetgroup on your experiences in doing the 
exercise. 

2. Review the Reference Information from Session 
Four: Collection of NewJs Assessment Data (page 
28), and from Session Five: Analyzing Data for 
Decisions (page 38). Throughout this exercise you 
may refer to these materials as you wish. 

3. During this exercise, proceed as you might In a / 
work situation. It is a simulation of what exists 
and occurs outside a training room. 

4. Since the planning process is presented here in the 
context of community program develbpment, re- 
member to use yourtact and social skills as you 
complete this exercise. 

5. Trainers are available to help you during the exer- 
cise. Ask for help if you need it. ' ^ 

6. Follow the directions carefully, and discuss the 
questions provided on the data recording form. 

7. The exercise materials are arranged as follovys: 
V Assumptions 42 

Brief Overview of APIE County . 42 - 

Selected APIE County Health 

Department Recordl^ 44 

Selected Fife and Rescue Squad 

Records 47 

Selected Data from Community t 
Resources . 48 



Ass^umptions 



Your small group represents a community task force to 
wbrk on alcohol -related problems in APIE Cdunty. As a 
result of a preliminary investigation, you have concluded 
that there is some evidence that alcohol abuse is a prob- 
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lem among elderly persons in the county, and this prob- 
lemktalgfnint has been formulated: 

Prdblem Statement: Persons over the age of 62 
in AP(^E County are abusing alcohol to the ex- 
tent thattheir health and safety are being 
scrioujiy affected. \ 

Your task force is now conducting a needs assessment on 
this population group.to make a recommendation to the 
county alcoholism agency about whether or not a pro- 
gram should be designed to solve or reduce the problem. 

The accompanying materials have been collected from 
agencies and other groups by members of your task 
force. You may find that you want to gather other 
kinds of data to decide what your recommendation 
about a program will eventually be. If so, draw on 
what you know of APIE Count>t.and your home com- 
munities and then assume that the da|a you fabricate 
was actually collected by the task-fdrce. 



Brief Overview of aIHe County/ 

(Summary of Information Obtained from the County 
Records and Other Sources) 

APIE County is not a wealthy count^ut sources of 
employment are quite steady and the c^ of living is 
relatively low. The unemployment rate peaked at 5% 
a year ago, and has declined steadily to 4 1 /2% now. 
Most workers are employed in a small plant manufactur- 
ing plastic desks and office supplies. The next largest 
sources of employment are in the service and small 
business areas, because the University pf APIE is lo- 
cated in the county^eat. 5- 

i The University of APIE was a private university up until 
10 years ago. As a private institution the University of 
APIE had an enrollment of 1,500 with a faculty and 
staff of 80. Now that it is a State University, the enroll- 
ment is 6^,000 and with a faulty and sUff of 200. As 
the University began to grow so did construction and 
other service-related jobs. Because of the University's 
growth, it has become an integral, influential part of 
APIE County. The University of APIE Sphool of 
Social Work has a national repuution. Dr. Everett 
Young, head df the Social Work School, has spent a 
great deal of his professional life working on problems 
confronting elderly people, 

43' 




With the advent of Federal revenue sharing and similar - 
legislation, APtE County has doubled its economic re- 

Vl^urces and expanded city and county government 
services for its citizens. The APIE County official sta- 
tionery bears the slogan; "A Progressive County on the 
Move/' and in fact, this does represent the attitudes of 
both the private and government sectors over the last ♦ 
decade. 




SESSION FIVE 
WORKSHEET 1 



The last census showed a total population of 80,250, . 
• all but 10,500 residents in the county seat, APIE City, 
or its suburbs. Nearly 8,000 (1 0%) of the population 
are over the age of 65, and approximately 35,000 (24%) 
are under the age of 35. The over-65 population resides 
mainly in APIE City, with fewer than 500 in the rural 
^ areas of the county. Of the 8,000 over age 65, 4,500 
are women; 3,500 are men. 
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Seiec^ted APIE County Health Department Records 



; ;Cofrtmunlty HcaJth Nur$« Home Visits to Persons Aged 65 and over in 1976 


. Numb^ 
of Visits 


Sex 

M 


F 

.f 


Primary Reason 1 
for Visits 


Evidence of . - 
Aicohoi Probiem ' 


35 


15 


20 


Administer medication ^ 


7 5 


28 


- 10 


18 


Provide treatment ^ 


4 3 


22 


6 


16 


Health education/advice , 


7 2 


85 


" 31 


54 


<» 


18 - 10 


Questions 




• 







1. 

2. 
3. 
4. 
5. 
6. 



7. 



What Is the total number of visits to women age 65 and over? \ , 

What is the total num*ber of men exhibiting alcohol probiemi/ 
Hovk< many women with evidence of alcohol problems were visited mo^e than once? 
How many women were visited for more than onp reason? 
What evidence(s) of alcohol problems were found? ^ 

How well prepared are community health nurses to recognize evidence of alcohol problems? 
Is the information given adequate for your assessment needs? 

If you were collecting data from community health nurses on the prevalence of alcohol abdse among people 65 
years and older, what pieces or kinds of information would you seek? Why? 



ERIC 
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Errtcrgcncy Room Treatment ofl'ersons Age 65 arUd Older in 1976 



Types qf Injuries Treated 


M 


■^11 


Contributing^ Factors 


c 

r 


M 


Fractures 




11 


' rails 


50 


32 


(it)ntusl6ns 


21 


■'46 


Auto Crashes 


^ 21 


11 


. Concussions 


• 14 


12 


Weather Conditions 


12 


19 


Bi*ns 


9 


23 


Physical Disabilities 


29 


22 


Cuts 


16 


25 1 


" Fires 


3 


6 


Eye Injuries 


5 


2 


Alcohol Consumption 


3f 


29 


Gun Shot Wounds 


2 


* 0, 1 


Other Drug Use 


37 


18 


Stab Wounds - 


1 


0 \ 


Totals 


183 


137 


Poisons 


1 


5 


GRAND TOTAL 




320 


Drug & Alcohol^eactions 


6 






Other Drug Reactions 


,10 


. 16 1 








Totals 


124 


207 ■ 1 








GRAND TOTAL 




431 t 1 









4 



Questions 

; 1 . How do you account for the fact that the grand totils differ? 

2. What changes in format or arrangement would makelthese data clearer to read? 

3. Are emergency room records of contributing factors usually complete? Accurate? * 

4. What other information might you seek about emergency room patients for this needs assessment? 



4t 
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Questions 

1. 



sr 

Selected APIE County Law Enforcement Records 

'^sposltion of 1976 DWI Arrests of Persons 60 Years and Older 



Arrests 
M F 




Disposition of Case . , 


12 22 




Released in Custody of Family or Friend 


15 5 




Placed on Probation 


41 10 




Sentenced to DWI School 


5 3/ 




Referred for Alcoholism Treatment 


12 0 




Senteflfjced to Jail and Fined 


1 1 




Licenlse Revoked 


86 « 41 







What do the data reveal about the incidence of drunk driving among the elderly in APIE County^ What are some 
implications of this? ' ^ 



2. What do they reveal about law enforcement policies tovi^ard DWI and the people arrested for it^ 

< ' .- 

3. How do these dau compare with those in.the County Health Department records? 

4. What other information might you want to seek from law enforcement records or personnel? Why? 



< 
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Selected Fire and 
Rescue Squad Records 

Summary of APIE City Fire 
Alarm Responses m 1976 

Number of 

Fires Extinguished 
Fires Out on Arrival ' 
False Alarmi" 



3tl|l 



Summary of APIE City Rescue 
Sq^ad Responses in 1976 

Number of Persons 

treated at Scene 
Transported to Hospital 

Total Persons Attended 



Types of Calls 
Fires 

ar Wrecks 

Drownings 

Heart Attacks, etc. 

Other 

Total Responses 



191 
212 
178 



To'til Number of Fire Alarm Responses 581 



216 
102' 

318 



316 
297 
6 
103 
25 

557 



Fire and Rescue Squad mehnbers estimate that persons 
over 60 years of age are m some way involved in approxi 



mately 20% of their calls. That is, they are victims or 
potential victims in fire scares and other ^isis situations. 
They are, however, not often known to cause serious 
fires (e.g., ones in which property damage e^\i^ds.$500 
lor people are injured pr J<illed). Furthermore, they re- 
port that fewer than'^^lf:.a dozen older people were 
visibly intoxicated when the squad responded to fire 
alarms or rescue calls during 1976. The Fire and Rescue 
Squad members regard smoking as far^more dangerous 
than drinking, but admit that combining them Is a 
"really bad mix/' ^ 



Questions 



How accurate and complete do you judge these 
data to be in regard to the problem under cpnsidera- 
tion? Why? ' 

What questions about the elderly citizens.are raised 
by these data? How could you get those questions 
answered? 



How do these figures jibe with the ^ata from the 
County Health Department? What does that 
imply? 

What other data would you like to have about the 
health and safety of this group of people? Where 
*'Would you look for such data? How likely is it 
that you could obtain it? 

Examine the pre5entati<5fi/\ormat, and content of 
the data. Would you make any changes? V^hat 
would yothchange? Why? How? 



2. 



4. 



5. 
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jSelected Data From 
Community Resources 



lurces 

^\^th Dr. 



with people and do something worth whij^ as they 
used to do when they worked or weres^wsing 
families. , > 



Summary of interviewlldth Dr. Everett 
Young of APIE University's School 
of Social Work 

' Dr. Young says that one of the most serious problems of 
older persons In APIE County (and in other plaoes) is 
loneliness and isolation. He says that there is a good 
program for them here, but it is not good enough. 

Three years ago in January, two of Dr. Young's graduate 
students mailed a one-page questionnaire to 300 APIE 
County retired residents receiving Social Security. A 
total of 275 completed and returned theijpestionnaire, 
revealing the following main patterns. I^v*^^; 

1 . Of the 275 respondents (9 j menf 1 84 women), 1 83 
said that as retired persons they found ,time drag- 
ging for them. Except for sports events, a majority 
of the men said that television was boring. Of the 
women, 140 said they used television to help pass 
the time but would not suy home to watch a pro- 
gram if they had something better to do. 

2. Two-thirds of the women lived alone, whereas only 
1 5 of the men did. 

3. All but 25 of the respondents had relatives living 
in the county, though they usually saw them only 
every two or three months. Holidays and birth- 
days, however, were almost always spent with rela-l 
tives. All but 26 of the solitary women had enter- 
tained relatives at least one meal in the previous six 
months; only 4 of the men living alone had dorfe so. 

4. Two-thirds of the men and three-quarters of the 
women reported that they drove their own cars. 
The remainder depended on others or public 

- transportation. 

5. In response to the question, "How has retirefnent 
changed your habits?" 42 men and 63 women 
noted (among othcf^things) that they were drink- 
ing alcohol on a daily basis now. 

5. Of the men, 28 said they attended church services 
at least twice a month, and 109 of the women re- 
ported the sanrre. Participation in church societies, 
however, was much movt limited: 7 men and 37 
women were active in church groups. 

h All bu9l6 men and 20 women indicated that they ^ 
wished tfiiey had more of an opportunity to mingle 



Questions 



1. 



3. 



4. 



On the^tiasis of the graduate students' data, do you ^ 
agree with Dr. Young's ajspssment of the problem 
or not? Forwhatspeciwc reasons? 

Consider how you would arrange these data for 
easier study and comparison. Use a sheet of flip- 
chart paper to illustrate what you have in mind. 

Many pebple are critical of self-reported data be- 
cause there is no way to checic the accuracy of an 
anonymous form. Are you suspicious of these 
data? Why or why not? 

In lijght-of the problem being investigated, what 
other inquiries would you malce? Of whom? 

Summary of Report on the University 
of APIE's^hool of Pharmacy 
Drug Knq^ledge Project 

As a ternf project, five upper level pharmacy students 
surveyed drug Icnowledge among customers purchasing 
medicines in five APIE Qty drgg stores. The following 
pieces of data are extracted from their report on 50 
interviews. " ' 

' 1 . Have you (or has the patient) used this medicine 

• before? 

• Yes 38 ' No JIO Uncertain 2 

2. How did you happen to-first buy this p/oduct? 

12 Doctor's prescription 

= ^ Pharmacist recommendation 

17 Family friend recommendation 

7 Advertisement 

_6 Piclced it off the shelf 

3a. Are you aware of any cautions on using this medicine? 

Yes 4_ No 46 

3b. If yes, how did you learn of them? 

1 Doctor's directions 

1_ Pharmacist's warning 

1 Paclcage or lab^i statement 

0 From a frien^J or relative 
^ _0 From "^the media 

1 Previous unpleasant experience 
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Do you usually ask the pharmacist whether or not 
there are Cautions about using a new medicine? 

^yes ■ 3 No 4£ Occasionally 3 



.^Hav^ you ever been cautioried abbut drinking alco- 
'hoi while you are using a particular drug? 



Yes 5 



Questions 



No 45 



1. What additional information do you need before 
, you can judge the relevance of these findings for 

your needs assessment? Why? Where would you 
go for it? ' 

4 

2. , What difficulties can you identify in this method 

of daU collection? Why? How might each be ' 
.overcome? ^ * 

3. What educational implications is a survey like ' 

^ this likely to produce? Who should by educated? 
About what?. 



idbe< 
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The Senior Citizen Volunteer Program 
(SCVP) Membership Group Meeting 

The Senior Citizen Volunteer Program (SCVP) involves ^ 
approximately 300 persons 60 years of age and over in 
a variety of volunteer activities in 'APIE County. They ' 
provide services for hospitals, nursing homes, house- 
bound senior citizens (e.g., visits, daily telephone checks, 
meals-on-whee|s, sort and deliver mail or flowers, etc. 
to patients). Tl^ey also staff the reception desks for 
large community meetings and conferences held in 
APIE Courtty. They make presentations on their 



careers, travels, and hobbies and take^part In other 
/activities with the schools and community groups. 

In genewd^ ^fieir purpose is to bring satisfaction to 
senior citizens by promoting their involvement in and 
contribution to community members and events. 

1 . ^ Given th^ Information in the data above and your 

analysiSo^it, wf)at Information would yoii seek if 

this mcmbwy^ of 300 persons invited your task 

force'to an explor^ry meeting on the probjem 

under consideration? How would you collect It? 

How could it be organized for use by the task 

force? 
• 

^ 2. How wbiild you organize the data if the SCVP 
.^oup asked you to present an interim report to 
them? What considerations would affect your . 
choices? How would you interpret that one set 
of data in your presentation? Why? 

Directions for Optional Additional Data 

If your group Wishes, spend pot more than 10 minutes;: 
brainstorming other kinds of data you might seek to 
collect, what the sources you might use, and how you 
would go about collecting the data. Keep in mind the 
purpose of th^needs assessment and the requirements 
of the person (s) who will use the results of the 
assessntent. 

DirecAons for Data Organization Exploration 

As a group, review the materials supplied above, and 
whatever you may have fabricated. Spend at least five 
minutes considering how such dita might be organized- 
and reorganized-to assist and sharpen the analysis of the 
data. 
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Gutdes for Setting Priorities 
and Making Decisions 

V ■ ' ' :^ ... ' 

Priority setting and decision makinf^re complex pro* 
cesses in which the rules that operate are often unclear. 
The purpose of these guides, therefore, is to alert the 
planner to the kinds^'^of topics and questions that can 
help to replace subjectivity and intuition with a meas- 
ure of objectivity and evidence for setting priorities and 
making decisions about identiified problems: 

Rather than simply saying, *1V^epends," when the 
priorities or decisions of one's agency are questioned, 
the planner should be able to cite what it is that the 
priorities or decisions depend on. To be sure, some 
influences are stronger than others, and the strengths 
of the influences vary from time to time and from ^ 
place to place. This will be dealt with further in / 
Session Seven. For the moment, the fooWing ques- 
tions are designed to sharpen the vyay planners ap- 
proach decisions that are to be made oh the basis^of 
the needs assessment data. ' . J 

What are some basic questions that community pianners 
should ask when confronted with evidence of more than 
one community prpblem which is worthy of attention? 

For each problem i\\t following sorts of questions'should 
be raised. 

• Does it appear that it is possible to solve this 
problem? 

- Can the probleni be reduced if not solved? 
To )|9hat degree?' 

- Can parts of it be solved? Which ones? - 

• What segments of society are directly affected, 
by this problem? (e^., women, parents, young 

, children, nurses, low income people, auto 
drivers, German-Americans, singles) 

• How many people are directly affected by this 
problem? (e.g., 40% of all women, all auto 
drivers) ^ 

• In what ways and to what extent are those 
people affected by the problem? (e.g., time/ 
money costs; injury/illness/death/discomfort/ 
seriousness or continued impact) 

• Is tills problem one that falls wthin the scope of 
this agency's goals and activities? 

- If sOji which one(s)? 



— If not, is there some other agency within 
' ^ whose goals it might fall? 

• If another agency's goals encompass this prob- 
lem) how could this agency be involved in the 
solution of the problem? (e.^., sharing special 
knowledge or resource personnel) 

• Is this problem one for which there is now* 
strong evidence of general community concern? 

— What likelrhood is there that community 
^ support could be generated? * 

— How could it be generated or increased? 

• Is this a current, but probably temporary, 
problem? ^ 

— If so, what is its likely duration? 

— What is the probable scope of its impact? 

On what bases can priorities among 
"worthy problems" be set? 

When several problems have been inves^ated and found 
to be worthy of attention, attention usually focuses^n 
the following considerations: 




the likelihood of solving or reducing each 
problem^ ^ 

the urgency /seriousness/importanceT of each' 
problem's impact on the community and seg- 
ments of the community; 

the estimated extent of current or predictable 
community support for working toward the 
solution to each^oblem; 

the priority ranking that the agency or planning 
"Ifoup has already established for certain target 
groups, regions^ program emphasis, etc.; 

the feasibility of being able to locate and obtain 
the resources required to work toward the solu- 
tion of each problem; and 4 

as an ever present political reality in community 
program development planning (and in other 
situations also), the possible involvement, in- 
terest, or support of some community member 
or group which cannot be ignored (i.e., influence, 
power, or clout). ' 
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What usually determines the 
relative weights of those bases ' 
|n priority setting? ^ 

fieUtWe weights of the factors involved in decisionmak- 
ing vary from problem to problem^me to time, com- 
munity to^mmunity, agency to agency, and people to 
people— and/or any combination(s) of these. The impor- 
tant actioris for planners to take in dealing with relative 
weights In priority.setting are; 

• identify as clearly as possible each of the prob- 
able sources of influence; 

• determine as precisely as is reasonable the cur- 
rent relationships among the inf1uences»(e.g., 
last year's priority for an organization may not 
be this year**s; some feuds smolder for years 
whereas new and unexpected alliances are 
spmetimeVformed); and 



work ctosety and tactfully with community 
members to rank the problems when more 
than one appears to fall in the high priority 
category. 

> 

Aifthough a planner or agency may bear the ultimate 
legal responsibility for action, care should be taken to 
make certain that there is community support for the 
action. This not only strengthens the chances of sue- ^ 
cess in working on a gj^ep problem, but it also bolsters 
the position of the planner or agency If difficulties or 
opposition shoul^arise. 



What is one particularly effective 

way that planners can show what 

different problems cost a 

community and the savings that ^ 

could result from solving them? 

\' . • 

• Planners^ can prepare comparative projections 
( on the [dative costs of each of the problems 

and their solutions. Coniparatlve1)rQjections 
can be made, in terms of economic, human, 
and political costs of the problems and 
solutions. ' ^ 

— Economic costs are by far the easiest to 
figure,~although doing so does involve con- 
siderable-work. 

} 

— Human costs are much more difficult to 
measure precisely, but they may offer 
especially persuasive arguments. 



• Showing a commu|iity some estimates of what 
a problem costs— in any terms— and what its 

^ solution might save, often serves to motivate, 
and elicit support from segments of the com- 
munity that are not otherwise likely to con- 
cern themselves with community alcohol 
problems. y 

Who should be involved in priority ' ^ ^ 
sett^g for a community? How? ^ 

•*The two main groups invoked in setting priori- 
ties are the alcohol agency or organization and 
community representatives: 

— the community planner and whateverothel' 
persons from his/her agency may have \\ 
authority, responsibility, or particular ex- 
perience in community work of this sort. 

— the key community representatives or 
spokespersons who have been involved, from 
possible problem area identification through 
the other needs assessment activities. 

e Involvement should occur within clearly defined 
parameters; i.e., if an agency or a board is 
legally responsible for makin^final decisions, 
community members should have been made 
aware of this from the start, in a tactful way, 
and their advisory role clarified. 

• Before priorities are set among these problems, 
if any of the defined problems are likely to re- 
quire the cooperation of other agencies, organi- 
zations, or groups, the planner should find out 

, how his/her problems rank anfiong the priorities 

* of those other agencies, etc. 

Is a list of priorities static or dynamic? 

As with virtu^ly everything else in a planning process, 
a pri^S-ity list shoufd not be regarded as static or final. 
Priorities can be changed— but not on a mere whim- 
when the situation changes and/or new information 
indicates the need for a change. For instance, the day 
after the planner and his/her group decide on the 
problem to which th^r efforts wiJI be applied, the 
newspaper announces that a professor at the local, 
university has deceived, a handsome grant to wof k on 
the same problem in much the same ,way. 

e Admittedly this should not have come as a 
'surprise if the planner were truly in touch 
with the community, but once in a while 
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there is a surprise which must be taken into 
consideration. 

• In this case, the planner and his community * 
^oup might elect to work on their second- 
ranked problem. 

Once priorities among the problems 

are set, wh^ happens next? * 

A d^sion is made about which problem will be worked 
on^ first, second, ejc. It was for the purpose ofmaking 



this dccisibn that each of the assessment activities was 
carriedsSlit; Making this decision completes th^ needs 
assessment activities, and the planning process moves 
mto the program design phase. 

• Although an agency might in fact elect to 
wonk on %verai problems simuluneously, for 
the purposes of ilhjsUation and simplicity, this 
training program proceeds on the assumption 
that the individual planner is approaching the , 
solution of a single problem. 



/ 





Data Analys^rSnd 

Decision Making Exercise ^ 



Directions : 

tTrawing on. the needs assessment data from the simulated 
community exerase recently completed, deterpiine as a 
task force whatiaction y6u will recommend on the prob- 
lem as.suted: * ' ' f 

Persons over the age of 62 in APlf Coun^are 
abusing alcohol to the extent that their h^ltb 
and safety are being seriously affected. 

Three options are open to you: 

recommehd that a plan be developed to attack 
j;|jj|e problem as suted; ^ | ^ 

• recommend that the problem be rejected; or 
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• recommend that the problem be restated and 
a plan be developed to attack the problem as 
restated. , . . . ' - 

Whichever option is selected, the gtoup should be pre- 
pared to present needs assessment evidence in>support of 
the recommendation. The data were collected so that 
this^ decision could be made about the stated problem. 

In a real community setting, it is quite possible that ilhe 
task force might have conducted needs assessments oh 
several stated problems. In that case, a decision from . 
among the three options would have to be made for 
each problem. Then, priorities would be set among all 
the. problems that were accepted for wor^k. ) 

From what you know of APIE County<<£rd other places 
like It; consider briefly whether there /night l^e other . 
alcohol-related problems that should be ranked as ^ 
higher priority(s) than this one. Support your view^ . 
with'^data provided or fabricated in the last exercise. 
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Looking Ahead to Analyzing Data 
Back.Home 

Directions: . 

gj^,-:. Rcvieiv^ plans you made for collecting data on 
your bai:k home problem sutcment in Session 
Fdur (page 34). " rr^^.^^_ . 

2J '^^aking jjt least tWo different kinds of dau l><g^^ 
/ there,J>egfn'to rough out some»possible formats 
for recording the needs assessment data you ex- 
pect toget; . 

• . . ■ ' ' , ■■' . _ ' . r 

3. Be conscious that die followin^are among the 
. sorts of considerations you wilj want to include 
your deliberation: ^ 

^ • clear and infopnativp titles; ' >i 

•-^oocise bu.tjtjfi^aningful heatBngs for columns, . 
sections, car portions of the information; ' 

. major labels (e.g., students, residents) arjl mitjor 
labels (e.g., male ahd^fgrriale- grades six, seven, - 
' and eight; home . pwners and renters); an^ 

• space arrangement and markings for clarity, and . 
ease of reading, incl{jdifig * 

— Shape of paper to be used ^ 

— Size of paper 

— Width of Columns 

— Space between columns 
yse of lines and underlining 

^ -V Use of ail capital letters; cafjltals and small 

• ^letters - 



- Spacing on tiie page (e.g., center headings,* 
margin headings, indented headings) 

- Lteof bullets and hyphens. (e.gi,.« and -) 

- Use of alphabetic and numerical outlining 
Use of footnotes 

• Graphic presentation of data 

- Arrangement iri graphs, charts, tables, maps 
(e.g., bar, line, pie graphs, etc.) • 

Thick and thin liries, broken and solid lines, 
etc. . ^ ■ ' , . '* 

- Different cotors ^ 

• — Symbols and designs (elig., arrows, dots, 

boxes, circles, stick figures) 

4. : Plan formats that will be clear. However, bear in 
mind that it may be necessary to record data in 
relatively simple ways first (e.g., each school or 
grade separately) before combining several sets 
into a broad representation (e.g., all third grade 

^ ' girls in the city). , - 

• In recording data, be aware tha\ the more com- 
plicated the format, the greater the chance for 

•error (e.g., filling in the wrong column or 
V. square) ^ 

5. When you have roughed out some samp^, share 

- them with 'your dyad partner or o'ihers in the small 
group. ^ \ . ■ ( 

* , . ' ■ ' 

•vFrom your titles, labels, and arringementSK:an 
. they, tell you the krnd(s) of information they 
would expect to find on the p2ige? . 

6. Plan ahead as carefully as ybu can, but never be 
reluctant to redesign a format if people are getting • 
the wrong message from it. ' .. ^ 
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SynofMis: This^scssion introduces the program desigr^ 
cofnpahent of the planning process. Participants learn 
howio formulate goal statements that are responsive to 
the need(s) of the target group identified during the 
assessment phase and selected for actioh? The s^sion 
emphasizes that goaU are outcome or result statements 
ah4 not activity statements^ It lays the groundwork for 
the specification of concrete program objectives. 

.Objectives: Participants will: t, ^ 

• given problem statements based on the sirRu- 
lated community, write goal statements ac- 
cording to training program criteria, and 



- ^^^^ • * 

• write a goal statQpient responisi've. to their back- 
home problem statements as formulated in the 
assessment sessions. 



Reference Information: Program Design 

Reference Information: ;Writing a Goal 
Statement 



Worksheet 1 : Goal-Writing Exercise 



56 

56 
58. 



5€ 



ERIC 



\ ■ 



55 



SESSION SIX 

REFERENCE INFORMATION 



J 



Program Design ^ 



After the Assessment Component of the planning pro- 
cess, in which a problem is systematically identified and 
selected for action by a prfegram planner and the in- ' 
volved community group(s), work on the second com- ^ 
ponen^^isoutlincd as follows: . 

PROGRAM DESIGN 



• State goals 

• Specify objectives 

• Choose strategies 

• kientifymajora^^ . 

• Determine and locate necessary 
resources 

• Deyelop time-phased action plan 

• Outline evaluation design 

The component called "program design" in this course 
is often cafled "planning^" in other courses and writings 
on the subject. The term "program design" is used here 
to avoid confusion between the overall planing pro- 
cedure that is the subject of this course and the specific 
program planning or design component that is one part 
of the planning process. .. . » 

* » .. ^ 

Writing a Goal Statement 

What is a goal Statement? 

The problem statement is deliberately phrased not to 
include a solution, but it doesimply a solution.* The 
goal sutement should sute the outcome that would 
provide that solution. In other words, i goal is what 
the program planner and the community group want 
to see in place or accomplished when i«plan to address 
a given problem has been tarried out 

For example; 

Problem:^ Alcohol abuse is a major contributing factor 
jn tcaenage vandalism and destruction of 
comhnun|ty property* , 



Problem: The public lacks information about the 
understanding of alcoholism as a disease. 

Goal: yVoiprovide the public with aif awareness 
\ C : program on the disease concept of alcoholism. 

Problem: A very small percentage of alcoholic^omen 
are receiving treatment through t^c commu- 
nity service network. 

Goal: To increase the number of alcoholic women' 
receiving treatment through community 
services. ^ 



Goal: 



To. provide a program for teenagers that will 
redu^^ Ihe alcohol aluis^^t leads to de- 
struction of communify property. 



What arc the characteristics of a goal statement? 

• Jt implies ^ broad and general solution jjy identi- 
fying the desired outcome. 

' • It specifies the target group (e.g., teenagers, the 
public, alcoholic women). ^ * 

• It.focuses on a selected need (e.g., prevention of 
alcohol abuse among teenagers, (ack of informal 
tion about alcoholism as an illness, small per- , 
centage of alcoholic women receiving treatment). 

• It is consistent with the agency's mission or pur- 
" pose (e.g., developing a prevention program, dis- 

sieminating information, extending alcoholism 
services to a neglected population). ^ 

■ ' ■ ' ■ " 'T) 

What is not Included in a goal statement? T j 

It is iniportant to notice that the goal statement identi- 
fies only w*(7/ will be accomplished. It does not specify 
how the outcome will be achieved, when it will come 
about, exactly Aow /yjany individuals will be affected or 
to what extent, for example, the sarhple'goals do not 
tell what kind of prevention program for teenagers will 
be instituted; which mefnbers of the public will be edu- 
cated by what means; or how the numbers of women 
alcoholics treated will be increa^d. The specifics for 
achieving the outcome are developed later, in the form 
of objectives and strategies. 

What is the purpose of developing a 
goal statement? ^ . 

Tnere are several imporUnt reasons for stating a goal 
before moving immediately to objectives. 

First, particularly when the program planner is working 
with a community group, a variety of concerns, pref- 
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erenc^, and special interests may exist. In such a situa- 
tion, often without intending to, people often "hear" 
quite different messages. Each one operates from his * 
or her own frame of reference in a discussion. There- 
fore, it is essential to be ceruin that, regardless of 
wherever e^ person is "coming from," the group is 
focusing on the same thing. 

A goaJ statement spells out that focus in a general way 
rtrrd so provides a point of agreement from whi^h the 
\9flBimiunity program developer and thc^nvolved com- 
mupii^4)eople can move on to specifics. If the members 
*of a planm'ng group are thinking of several different out- 
comes or solutions to a problem, that must be brought 
out and dealt with at this time, rather than accidentally 
discovered when someone eventually^says, "Is V^rhat 
we're trying to do? I thought we were dbfng so-and-so." 

Second, like a politician's campaign speech, one purpose 
of a goal statement is to elicit support around a point 
of basic agreement. Once planners have reached \^ I 
agreement at a global level, the likelihood of later reach- 
ing agreement on necessary details' is increased. Plunging, 
too soon into details has snarled many a community 
effort in nit-picking and time-wasting purstHts, JGIoq^ 
quently, even though the program planner may already 
have leapt ahead mentally to the point where he/she 
could state (Objectives, the goai statement activity, must ' 



not be short circuited in planning for community pro- 
gram development 

Furthermore, startirig at the global level of a goal sute- 
ment greases the probability that the focus will not 
be n^iPDwed tod soon. When a solution is considered in 
a bro£l context, a number of worthwhile alternativ^es 
may be presented and considered that would probably 
not even be brought up if a precise objective sutement 
were offered at this point 

In addition, formulating a^al sutement ensures that 
tfie solution falls within the agency's scope or mission. 
It may help ensure that theigency is not impinging on 
work already being done by another agency or group— 
resulting in a duplication of eipfort or a political em- 
. ^barrassment Furthermore, formulating a goal state- 
^ jTient n)^tsuggest ways in whfich the agency can comple- 
ment oi*'ehhancc another program or programs. 

In summary^ ajgoal statement is a broad statement 
r^spon§iye^to a sUted need. It provides the w/?<7f infor- 
mation, as distinct from the how. It serves the purposes* . 
of clarification for concerned individuals and groups, 
provides a basic focus of agreement, serves as a check- 
point regafdiVig the i^ency's nriission or goal, and pro- 
vides a basis for selecting means and resources to imple- 
ment a solution. 
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Goai-Writing Exercise 

This exercise has two parts. In fart 1 you will be given 
three problem statements drawn from the simulated 
APlE<^ommunity. You are to write a goal statement 
for eaqh, containing all four characteristics of a goal 
statement. 

_^For Part 2, take your back home problem statement 



and wr4te a goal statement, again containing the four 
characteristics listed in this session. 

You have 10 minutes to complete both parts. Then for 
• 10 minutes, meet with your partner and check each 
other's work to be sure that each goal statement in-^ 
eludes the four characteristics. 



Parti , ^ 

^Frob/em #1; A sigrfificant number of senior citizens are becJ^Jm[ng ill as a result of consuming alcohol while taking 
medications. . ' 



Goaf #/; 



Probiem #2: Alcohol consumption has been a factor in oCer 25% of the automobile collisions caused by people over 60. 
God/ #2; - ' . , ^ : " ' 



r 



Problem #3: A significant number of immobile senior'citizens are consistent consumers of excessive amounts of 
^^Icohol. ' ^ - ^ 
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• write a program objective for their back home 
problem. 

Reference Information: Thi Essential 

Characteristics of a Program Objective. ...... 62 

Worksheet 1: Exercise on Characteristics of ^ 

a Program Objective 63 

Worksheet 2: ^Writjjjg Program Objectives from 
^ Simulated Community Goals 73) 

Worlcs^eet'3: Writing a Program Objective for 

Back ^^"ll^ Problem. 74 

Reference Information: Outline of Evaluation 

Design * . . . : 75 



Synopsis: In the previoi^s session, participants learned 
how to formulate well written goal statements for a pro- 
gram addressing an identified need. In this session, they 
work at making these outcome statements specific, time- 
phased, and measurable. When properly formulated, pro- 
gram objectives provide the bascrfor evaluating the 
degree To which a program goes according to|^n. 

Objectives: Participants will: 

• id^ify the four essential efements of a program 
objective using the criteria pVovided in the train- 
ingp/rogram; 

• given ^sample goal statement, write program 
^ o^ectives u$ing the four criteria; and 
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The Essential Characteristics of a 
Program Objective 

Wha^fa an objcctrvc? ^ 

An objective is a. statement which specifies the activity 
for reaching a goal or outcome. In conUast to the 
broad goal statement, an objective is much more precise' 

in stating how the outcome is to be reached. For 
example: 



Goal: 



Objective: 



qoal: 



Objective: 



Qoah 



Objective: 



To provide a program for teenager^ that 
will reduce the alcohol abuse that ikds 
destruction of community property. 

To sponsor a series of free monthly 
athletjc events for students at Luke High 
School from September to May of the 
next school y ear- 
To provide the public with an awareness 
program on the disease concept of 
alcoholism. 

To publish a series of five feature articles 
on the disease of alcoholism In the local 
newspaper during the months of October 
and November, 1980. 

To increase the numl^r of alcoholit 
women receiving treatment through com- 
munity services. 

To increase by 50% between January and 
June of 1981, the number of alcoholic 
women in Catchment Area D receiving 
treatment through the Beaver Valley Com- 
munity Agency. 



What are the essential characteristics 
Lof an objective? ^ . 

A useful objective has fou^essential characteristics: 



• identifies the faAyef^rof/p; 

• sutes the res£//f ; 

• in nieasurable tem%\ and 

• identffies the result wiljy^appen.^ 

. ■ ^ 

As the above pairs of goal and objective statements show, 
the target group is more precisely stated in objectives- 
Objectives identify dearly the persons with, for, oi- on 
whom the result will be accomplished. 

Likewise, theresuft is more specifically spelled out in an 
objective (e.g., a series of five feature articles on the 
disease of alcoholism is an awareness campaign). 

The result is sUU0(iltneasurab/e terms-how many, to 
what extent, etc^e^., 50% more than the number of 
alcoholic women now being treated through the Beaver 
Valley Community Agiency vs. alcoholic women). Some- 
times the measure is merely a yes or no: is the result in 
existence Or isn't it? Were the five monthly feature 
stories published or not? ^ 

Identifying when the result will happen simply means 
setting a specific date or a specific time limit within 
which the result will occur or be in place (e.g., withrns 
the next school year; during October and November 
y1980). 

A realistic awareness of what is involved in,.arid required 
for, reaching the objective must guide the planner in 
drafting objectives. The nextjsessions will provide some 
techniques and procedures for ensuring the reality of 
objectives. Fo)- the moment, it is wise to be cautious 
and conservative in sUting objectives. As^n illustration, 
. perhaps it will be more effective Sponsor events for 
the teenagers every weekend, rather than once a month. 
On the other hand, the plannerand community group 
may^nd that sponsoring the monthly events taxes 
them and their resources to the limit or beyond. 
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Exercise on Characteristics 
of a Program Objective 

For each of the following statements, put an X in the 
space beside each sutement that has these three charac- 
teristjcs: target group, specific statement of resu/t to be 
accomplished, and measurable terms. 



6. 



Conduct a campaign to increase public 
awareness of alcohol-related problems. 




Increase by two the number of coifimunity 
groups voluntarily contributing goods or 
services to the halfway house on a regular 
basis. 



1. 



Establish alcoholism referral system in 
the fivQ largest police departments in this 
Sute. 



Estabfish a suff benefit plan that is ac- 
ceptable to both board of directors and 
suff. 



2. 



Provide alcohol abuse prevention training 
to schoof teachers. 



Explore formation of a Sute halfway house 
association. 



3. 



4. 



Add one psychologist to the treatment 



• center's clinical suff as a half-time 
consultant. 



^ Reduce alcoholism to a level acceptable to 
the public. 



9. 



10. 



Assign additional counselors where needed. 

... <^ . V ' 

Reduce the unemployment rat^ for the 
.residents of the. halfway house by 50 ' 
percent. 



r 
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You jhould have placed an X before statements 1, 3, 6, 7 
10. 

Take another look at any you missed. Do those state- 
quents tell you specifically who the target group is^ what 
the expected result and how it is.to be measujU? 
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The fourth characteristic of a useful^jective is the time 
fmm; that h^wpm told exactly when the result will 
happ^tT^^ what date it will be completely 
acco|[nplished/ 

Which of the foiiowing statements specify a clear time 
frme? ^ 

1. As soon as possible. 



2. 



By the last day of each month. 



3. 



Immediately. 
When feasible. 




4. 



5. 



By July 1, 1983. 



Answer: 



(Number(s)) 



r, 
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Numbers 2 and 5 specf^cally state by what time, or date,- 
we could expect a result |p happen. The other statements 
don't tell us how soon Is possible; or when is immediately 
(tbday ? thh week?), or how soon feasible is. 

Useftil ob|ec^es must specify when'a result will happen 
. by stating a date or giving a number of days, months, or 
years. f , 




List below the four characteristics of a useful objective. 

0 > ■ . 



3. ^ 



7" 



r 
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The four essential chvactertstics of a usefuf program ob- 
jective are tfi^oilc^^iii^: 

Identifies the rofgef^oc/p, • / 

>tates specifically the result to be accomplished, 

m measurable terms, ^6 _ 

icjentifies when the result will happen. 

The order in which you listed them is not important, as 
long as it is clear what 4s being sutcd in measurable terms 
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Now try to find each of the four characteristics in the 
objective bclow; . : ' 

Objective: . 

Provide 8Q hpurs of inservfce training annually ' 
to aJI clinical staff m^piber^ within five years. 

T. Underline the parts of this objective that identify 
. .the target group.^ , ^ 

2: Double underline the partis that state the intended 
result ' 

3. a jboxj around the parts that are measurable. 



4. jjircldthe time frame. 



t. 




09 
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Your answer should look like this. - 
- Pro¥ide|80 hours[of in service tralnlng^nually ) 
to falil clinicai staff members within *five years. 



■7 



»-■ • 
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Now do 



with the following objectives. 



j. . Underline the target group. 

2. Double underline the specific result intended. 



box 



3. "Put a 

4, UCircle)the t\m& frame 



around the measurable parts. 



A. Provide medical and^^choh>gical screening 



services for all treatment applicants in this 
program within two years^ - A 



B. . Establish in this agency a statistical record- 

keeping system that is consistent with State 

.... ■ V ■ ■ ■ ■ " ■ 

^ association standacds by the tj^eginning of : 

'* ■<> 
( the next budget year. 

C. By September 3Cf, 1981^ provide 20 hours 
of traiiiing.to each of^SO shop supervisors 

in kJentifying ant^documenting unsatisfactory 
job perforinanjcs to ensure appropriate re- • 
ferral to company EiT>pJo]('e;e Assistance 
Programs. V 



\ 



SESSION SEVEN' 
WORKSHEET 1 



Your answers should bTmarked like these, 

A. Provide medicaJ psychological screening 



faciliti^es for applicants for treatment in this 
program ^ithin two ytmT) 
B. Establish in this agency a statistical record- 



keeping system that is consistent with Sute 



assoc'iation^standards ^y the beginning of the 



^next budget ye^ ^ 
C Q By September 30, 198 1^) provide f20l hours of 



training t( (each of 15^ shop supervisors in 
identifying and documenting unsatisfactory job 
performances to ensure appropriate referral to 



company Employee Assistance Programs. 



l¥Htini^ Prog/arn Objectives from 
Simulait8SI^€^munity Goals 



Goal Statement: .The goaJ of a pilot prevention i^ojgram 
i$ to provide information to the 'senior 
citizen population about the harmful 
effects of consuming aJcohol while 
taking medication. 

Your group task: 

.1, Work together to write two program objectives 
from the above goal statement ' 



\4 
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2. Oioose a reporter to record your objectives on a 
piece of flip^hart paper for presentation to the 

. large group. 

3. For each objective on the ^tpchart paper, 

. .. • ■ ^ .. ^ 

• Underline the par^ of each statement that 
' Identify t^^ 

• Double underline the parts that state the 
intended results:" r 

• Place a box around the parts that are 
measurable. - ' 

• Qrcle the time frame. 




Objective #/: 



Objective #2: 
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Writing a Program Objective for 
Back Homtf Problem 

• You have 10 minutes to formulatb a program objcc- 
tive from the goal statement you used fdr your "back 
home" problem. (Session 6, Wof kshcct 1 , page 58). 



Program Objective; \ 



1 . ' Underline the parts of this objective that identify tfthe 
, target group. 

2. Double underline the parts that sute the intended 
results. 

3. Place a |box | arounti; the^pdrts that are measurable. 

4. ( cirde )the timeframe. ' ^ ' 
o 4'* -■ 

• At the concision of this task, share the objective 
with your dyad partner. 
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Outline of Program Evaluation Design 

Often people think df evaluation as the last activity the 
planner engages in after the plan has been implemented. 
But evaluation begins as soon jas the goal statements 
and program objectives have been written. The goal 
-stoternent(s) idehtifies the broad^ areas of concei^n; the 
prc^am objectives state what the (Sfanner will do and 
how Jong it win Uke to accorjiplish the stated results; 
the third link-the evaluation design-includes the 
methods' and. pro^fedures the planner uses to determine 
whether or not he/^ie has succeeded in completing the* 
task. 

An outline of the^evaluation design s^iould include the. 
Toliwing: 



• the types of information >hat should be col- 
lected to determine whether program objectives 
have beeo achieved; 

• a^plan for collecting the'necessary information; ' - 
and • ^ 

• the date on which the evaluation findings will be 
^ reported so that the results can assist the planner 

in making necessary revisions m the existing , 
plan dr other decisidna about the program. , - « 

These parts of a prograVr? evaluation design should have a \ 
familiar tone, since they have already been encountered in 
the assessment component. A needs assessment Ls^ri fact, 
a particular kind of evalua^ion«activitV? ^ 
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Reference Information: Decision Model for 

SelectinglKtrategy . I . . . . 78 

'Worksheet 1 : Strategy Selection Exercise . . . T 80 

Reference Information: Agency and 
, . Communijy Resource Inventory i 
^ Guidelines : . . . . 82 

, Worksheet 2: 'Agency and Community 

Resource Inventory Eyrcise . . '."C. . , . 83 

Wor^he^t 3: Strategy SeJ /^tion and Resource 

' Inventory for-Bafck Home Problem . , . . ^86 



Knopsis: This session provides a model 16 help^par- 
oipants choose a strategy for carrying out the pro- 
ram objective{s). Participants focus first on identifying 
cssible strategies; next on choosing the strategy that 
ill accpmplish the objective with the fewest or least 
fmportant undesirable side effects; and then on idcnti- ' 
fylng the resources necessary to ca/ry out the strategy 
chosen. • 

Objectives: Participants will: '^^ 

• apply the four basic steps provided by the 
training program in choosing a strategy, and 

• • Wmplete an Agency and Community Resource 
Inventory. 
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scision Model for Selecting Strategy 

A^rategy, is the term is used here, is "the science and * 
art of employing the essential forces or resources to 
pr<jvi3e the maximum support to some adopted policy." 
It is the how for accomplishing objectives and goals. 

The decision model offered here for selecting a strategy 
,has four par^s. 

Part One: A brainstorming session and listing of all pos- 
sible way^an objective nwgit be attained.. All 
suggestiorWe listed as l^y are made. All sugges- 
tions made are equally acceptafc^le;no judgments 
about the quality of the suggestions are to be made 
at this stage. 

Part Two: Application of quality criteria to the list , - 
^ produced in brainstorming. Now judgments are j 

made about the qualjty of each suggested strategy. 

The following criteria should be uifed:' 

Is the suggestion complete! boes^t fully address " 
the ol^ective? ' 

• Is it coordinated (or can It be coordinated) X\ 
\ - ■ within itself, with other suggestions, and/or witf} 

what already exists? ' 1* 

. \. ^ ■} 

• Is it flexible enough to'accoWnodate possible 

•* future shifts in emphasis? V; , 

• Is it simple enough that it can be accomplished * 
wkhout a disproportionate amount of effort? 

• Is it explicit enough tPftfcl everyone whoVeads ir%«; 
will understand it the same way? ' ' 

Suggestions that do not meqt all of tjie quaHty criteria 
sh9uld be cither discarded~or ceworded so that they.. 
'm^Qt the criteria. - ' 



mented, but they may not be intended or ex- 
pected. ^Predicting them is difficult if the planner 
is not thoroughly familiar wjth the parts of the 
immunity involved and affected; e.g., what was 
done Bfefore and is being done now, -by whom, 
* and with what results. Side Effects can be favor- 
able, and if they are, they should be capitalized, 
on as soon as they are identified. They can also 
be unfavorable (or actually destructive) in their 
results. As soon as damaging or pptentially dam- 
aging side effects are identified, steps should be 
ta.ken to eliminate or decrease their undesired 
impact. Knowing the kinds o/ things which 
raise hackles among key people and segments of 
the community helps tre'mepdqusty in makingN 
valid predictions of outcomes, and thereby per- 
mits the avoidance of most unp|feasanl conse- 
quences. Conversely, capitalizing on the prefer- 
ences of key communify peopJe and groups 
^ gives the strategy extra support. 

Part Four: Setting priorities among th^ acceptable 
strategies on tf^^basis of the strengths of their 
^ advantages an6 disadvantages. Advantages and 
disadvantages can also be described a> positives ' 
and negatives-factors in favor of the strategy and 
factors working against it^and these factors can be 
giver^r;ftlative*values or weights to help decide on 
\hh merit of a given strategy, or to choose among 
strategies. This kind of weighting^procedure can be 

* diagramed as a fulcftfm effect. 



Pirt 




Three: The prediction of probable consequences of 
the^emaining suggestions. In order to avoid being 
surprised later, because an acceptable strategy did " 
all it was supposed to do-and some it wasn't in- 
tended to- ihe planner should predict two kinds of 
consequences'for^^h iacceptable strategy.v 
- Immediate or direct consequences of a sfrate^ 

* are ttae Qxpected ones. They are the/consequences 
which are sought. ;They are impoptant and reia- 
tTvel^^asy to predict. ^ 

• Indirect consequences or side effects of a strategy 
are ones which occur when a strategy is imple- 




/4 




Factors Restraining 
Chang^or Solution 



Factors Favoring 
Change or Solution 



Qhe^ositives outweigh the^ hegatives the balance 
\4Ftilt toward a positive oytcome anc^the strategy 
' will be successful. For exarrVple an objective may 
be to raisd$J,000 in matching funds, within 2 ■ 
months, f^a pilot|3revs;ntipn program for youth. 
Suggested sthategieic^ge from a fund'riising party 
featuring topfless danceW to a bake sale. 
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On the plus side, the party strategy might be* very 
lucrative. On the tninus side, it would be so offen- 
sive to so many elements in the comrrrunity, from 
the agency director to the volunteer women's 
groups, that the minus factors would at least out- 
weigh the pluses. ^ 




The bake sale might not offend anypne's sensibili- 
ties, but it would Uke a tremendous hUmb^r of 
cookies sofd to raise $i,00(Xwithin thfe projected 
2-mpnth time frame. 




> 



A third suggested strategy is to organize a work 
bank. Young people would do odd jobs for com- 
munity members a)jd the proceeds wouljd go to the 
yftjnd-raising effort. This would require some or- 
ganization to carry out on time, but would be suf- 

fjjpiently lucrative, would meet with community 
—Approval, and would have the added benefit of in- 
volving young people in a positive aqtivity. 




Therefore the third strategy is the one selected. 



The key feature of this decision-making technique 
is to assign some sort of weight or val^e to the 
factors in ^estion, whether by giving them numeri- 
cakvalues or simply labeling them as, for example, , 
major, moderate, or insignificant in importance. 

This decision-making method, which is similar to a 
Force Field Analysis^ can be used in any decision- 
making situation that involves a weighing of posi- 
tive and negative factors. For example, a similar 
procedure was i/se(f In selecting the problem focus, 
in asking, *^how important is this problem for this 
community?" It could be used jn chopsing a goal, 
by analyzing what positive and negative factors 
exist that contribute to the status quo, and what 
'additional positive factor or force could tip the 
balance in the desired direction (or prevent a shift, 
towara a less desiraJ^Je status or situation). It can 
be used in choosin| among sevei'al objectives, bal- . 
ancing expenditure of time and resources against 
impact on the, problem or fuftherance of the goal. 

Because many of the factors that must be consid- 
ered irL5x>m(nunity planning are intangibles that 1 
can 't^e* measured in numbers or dollars or any ^ 
' ^solute terms, the^knowledge of ^fie community " 
that tlie planner and planning group'have ls of 
crucial importance in rec ognizing and weig hin g the 
relative strength and direction of the forces or fac- 
tors involved. The^rength of this decision-making 
te9hnique is that it helps take.decisions out of the* 
realm of the vague and puts them pn a more solid 
foundation. , 
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Strategy Selection Exercise ^ 

Directions: Read the reference Information starting' 
on page. 78, Decision Model for Selecting a Strategy. ■<> 

P0 ■ - v...-- .... . 

Then, a$,a group, apply the Strategy Decision Model to 
the objective below, so that a strategy for implementing 
the objective can be selected. You will have 40 mmutes 
to complete the exercise. 

Objective: Within pne year, the incidence ofWmful 
effects (I.e.i those requiring medical trfeatment) from 
combining aJcohol and medication, wrU be decreased 
by 30 percent among the APIE County population aged 
60 and above. • ' 



1 . Select a recorder to list on thrflipchart all sug- 
gestions as you brainstoVm strategies for meeting 
this objective. (Maximum time: five minutes.) 

J 



2? With each group member taking a.ciifferent qual- 
ity criterion for special attention^ examine the 
' brainstormed list to eliminate those which do 
not meet the criteria. ^ a 

3. List the remaining suggestions, each on a^pa- » 
rate fTipchart Divide your group so that one or 
mor« person works on each acceptable suggested ^- 
strategy. Then, using the format below^redict 
the probable consequences of each of the ac- 
ceptable strtitegies from your group. ^ 'r . ' 

NOTE: Use what you know about, APIE County as ^ 
tt^e basis /or your predictions. Where it is necessary 
or appropriate, draw on your knowledge of your 
own corfimunity to add information that might 
help in identifying possible side effects. j 

/ 



Acceptable Strategy: . 



Birect consequences of this strategy. (Be specific.) 




/ ' 

) I 

/ 

/ ■ 


^ \ ... 




b. - V 




f V 


c, ■ ... •■ ' • • . • . ■ ■ ■ 


■J ■ . . » 

d. 4 • ' . ■ 








' V' 





Indirect consequences of^this strategy. (Bespecific.)^ r 



■i 



I 

4. When the Indirect consequences for all of the 
alternatives and acceptable strategies have been 
listed, go back to that list and rnark each in- 
direct consequence with a -f- sign (-^ = positive 

' factqr of feree) or a - sign (- = negative f^tor 
or force). ^ ^ 

5. Review the indirect consequences list once again 
and mark the .weighting you give^to^ach of the ' 
factors. Use either "major/"*moderatfe/' "in- 
significant/' or a numerical value torrepresent 
your weighling of the strengths of the 
consequences. 
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6. Examine the relative strengths of the opposing 
forces for'' the strategy(s) you have been working 
on and make a decision with the otherVoup 
members about which strategy should be chosen 
^to attain the objective. j 

^ NOTE: This same process is followed for the di?ect 
consequen(;es. With them, however, the positive 
and negative consequences and their strengths are . 
usually'more easily recognized. Therefore, the ^ 
focus here has been on the important but frequently 
<;>verlooked indirect consequences of a strategy. 
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Agenpy and Community Resource ^ * 
Inventory Guidelines 

After a strategy has been chosen for meeting an objec-^ 
tive and it^ goal, a program pfanner identifies the main 
activities which must be-dpne m carrying out the 
strategy. Then, he/she lists the resources for each ac- 
tivity and takes an inventory of their availability. 

As the «erm is used here, thp word, actiuity, describes a , 
rather broad process or function in a specific area of 
work which mjust be done to ^cbmpiish a desired ob-.. 
jectivc or outcome. Each activity is mide up of groups 
of related /os/rs. For example, "making a presentation 
to the Rotary Club on local alcoholism sem'ccs'' may be 
an activity that some program worker intends to perform. 
Amjng tjie tasks to be done in completing that activity 
ar^hese: finding out the charact^is^ics of the audiehce; 
selecting appropriate content and form for t^e jjre^nta- 
tion; preparing thepresenUfion; Identifying and collect* 
ing the equipment and materials needed for the pre- 
.sentation (e.g., film projector, screen, and fUm, pam- 
phlets); testing the equipment, checking on the avails 
ability of window shades and the placement^f electrical 
outlets, etc. 

BeforcMhe planner starts a resource inventory, he/she: 

^ — reviews the objective and strategy; ^ 

- fists the majqr activities recjuireti to carry out the 
strategy; i . 

~ checks the list of activities or reorders it'so that 
, the activities are listed //7 the sequence in which 

they are dor?\»;and 



specifier for each major activity the kl^dS^of re 
sources needed to complete the activity 



Although th^rre are many possible ways for planning a 
cpmmunity resource inventory, key questions to ask 
about resour9es are: ' , • ^ ^ ' V 

^ 1. WJi|t facilities, equipment, information, ^>eper- 
tise, personnef, money are requlreil to carry 



out the iob successfully; i.e., as it is stated in. 
t|ie objective(s)? » * 

r 2, Which of the required^resourc^s^are on hand and 
available when needed? Which resources must 
be mobilized? Which of the resources cannot 
be obtained? \ 

3, How important to the job are the unavailable 
resouf'ces? What other resources can be substi- 
tuted for the unavailable resources? 

4. Based on this resource^nvQntbry, is the proposed 
project attainable within the agency Vscope of 
resources? ' - 

' 1 ' ■ ' ' . ^ ■ ' • 

Ther^^are many ways that the Identified, necessary resources 
can be groupedv Sometimes an agency or a project requires 
some particular system of c^egorization. However, the 
following basic grouping pattern is one that many^planners ' 
find helpful: facilities,;Qquipment, supplies, personnel, 
and money, f ach of these, broad categories can of course 
be subdivided if desired (e.g., "personnel" might be sep?- 
.rated into several different kinds of^ersonnel: volunteers 
and paid staff; professionals antj paraprofessionals; cleri- . *' 
cal workers, maintenance staff? administrators, and treat- ^ 
ment staff). 

» . ■ - • 

Whatever categories are specified, the resource inventory 
%must be done with an e^e to reality. Just because a re- 
source is known lo exist in a community, the planner 
should not assume that it will be ma^ available for a 
given "worthy" project. The candid planner will prob- 
ably find that a great many important resources mus|^be 
niobilized. That's really what a community effort is all ; 
about, anyway. 



Some planners find ft more logical and produfctive to 
Uke gerftJral cesource inventories^ for several acceptable 
strategie's before selecting one strate^. That is all - 
right; the same pririciples and procedures apply. After 
othe strategy is chosen its activrlies are listed and the in- 
y^tory proceeds*as describedabove. ' 



^ • ' SESSION EIGHT^ 

^ * . > W0RKSrfEET2 

Agency and Community Resource Inventory £X^^ I C ^ * 

Directions: In doing this exercise, draw again orrVour own knowle^fte and exp^rienqe as well as. what you knc^w aboui - ^ 
APIEtounty. ... ' / ' . ^'V^-i 

You will have 20 minyres'ta c©rnplete this form as an individual. Whe" time is called, exchange youc, inventory Nv^lir poevM^^ 
or two others in your group). Critique each other's inventories anctgiv^ feedback on the%uslng the 'Agency ^pd; 
munity Resourte Inventory Guidelines for reference. . . - ' V ' 

Strategy selected by the group in the last exercise (Worksheet 1): % ^ 



The major activities that mwst ^e done to implement the selected strat^^y (Be specific) ' / 



^ 



T5 



■ J: ' ^ 
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Activity No. 1:. 



Complete th? Ihvcntory of the resources needed do that aqtivity. (If you need more space, use another sheet of ' " 
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Strategy Selection and Communfty 
Resource Inventory for 
Back Home Problem 



In^the following exercise you will focus b)i developing a 
strategy for your back home problem objective as de- 
veloped in Session Seven. You will then inventory the 
agency and community resources 'needed to carry out 
this strategy, r 

Part l-Brainstorming Possibfe Strategies 

Write the objec|iwe(s) you selected for your back home 
problem on a flipcfiart page and ask your smaH group- 
^o brainstorm possible strategies to carry out the objec- 
tive(s> in the space below.. A two-mmute lirriit is set for 
this activity. 



Part ri-Applying Quality Criteria . ' 

Consider the suggestions you have listed according to the 
following criteria:y:ompletehess, flexibility, simplicity, 
explicitness. (Refer to Decision Model, page 78, if 
necesjary.) Discard or rephrase any suggested strate- 
gies that don't meet the criteria.^ 



Fart 1)1— Analyzing Direct and irrdirect 
Consequences - . 

. " ■ • ' ^ ^ \ ' ' - 
Choose the strategies and list them on the next page. 



Part iy--Weighting C*isequences 

Label each listed consequence positive (+) orrf 
and a^^ign a weight to its importance or force.. U 
numeric scale or labels such as "ma>or," "moderate 
"insi 



Repeatlll and IV for each acceptable strategy 



Part Y-Developing Resource Inventory 




Take the Vbest'* strategy, the one with the fewest nega- 
tive and the most positive weight. List the major activity 
; V .pr activities involved in carrying it put in the spaces pro- 
' vided on the following pages. Nex<, list the facilities, 
equipment, supplies, personnel, and money neede'd Jo 
- ^ carry out the activity and chef k off whether each item 
. P'n Kaud, nee^s to be mobilized, or is totally unavail- t 
able. The work you'do at this stage is necess^rily*pre- ' 
liminary because of. the time constraints of the session- 
"t^ yo" will probably nee<J further information, 

tut itproyides a direction in which^to prQcee<^ later in 
— tl^t;aining prb^ranrvand biCk at ydur own agency. 



SESSION EIGHT 
W|pRKSHEET2 

(Extra copy for 
use back horae) 



Activity No. 1:. 



^ Complete the jptentory of the resources needed to do'that activity. {If you need more space, use another sheet of 
'paper.) * 
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Activity No. 2 



Complete the inventory of the resources needed to do that activity. (If you necfl more space, use another iheet of 
paper.) • «i 



Required Resources 



On 
Hand 



To Be 

Mobilized 



Not 
Available 
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Actjon Plan 




SynopiiSs: A tm)«-i>ha$cd action plan spells out the tasks 
related to each activity needed to carry out the selected 
: strategy; the order, phasm^schedule, and coordination 
of tasks; and the person(s) responsible for carrying out 
each one. This session teaches participants an easy 
method of going from a^elected strat^. and resource 
inventory to a detailed performance plan. 

ObjectWe: Partlcipantsrwill: \. 

• develop a time-phased action p\^n to carry out 



one of the major activities necessary for imple- 
menting a selected strategy. 

Reference Information: Time-Phased Action 

Plan Guidetlnes ^ 94 

Worksheet 1 : Developing a Time-Phased 

• Action Plan 96 

Worksheet 2: Time-Phased Action Plan for 

Back Home-Problem 102 
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Time-Phased Action Plan Guidelines.. 

A time-phased action plan is a mean^Tor the plafifier to 
show in graphic forms what his/her pJart involve^fwho 
does it, and when it is to get done. . 



f/on for its construct/oh involves these steps: 
a revfew of the program objectives 



a review of the strategy selected for Implement- 
ing each of the program objectives 



• a listing of the major activities which must be 
done to carry out each strategy 

y . • ^ 

• a reordering of the major activities so that they 
' are listed in their order of occurrence 

• a listing of the t^s whkh comprise^|^ of the . 



major activitie^^ 



• a reordering of the tasks in their order of 
occurrence 

• a review of the community resource inventory 

Developing on constructing a tlfne-phased action plan 
involves these steps: 

. 

• .specifying whaijmj^i be done (i.e.<: the activity 
- ' -tasks) Sri 



• Identifyfng w/7othe persons are that will be 
responsibly for doing each task, and 

• determining when each task is gji be Completed. 

The planner draws on the knowledge and experience tbat 
he/she and other available, reliable people have about: 

jf. . : . 

• the time, materials, and equipment-requirements 
for completing cac^\ task (e.g., and typists about- 
typing tfme and equipment); r ' 

• the possibility of a more economical use of re- 
• ^ sources by.combining or overlapping some 

tajiks and acti^ties, or parts of them (e.g^, 
aJtly^iugh they are listed' sequentially, the se- 
i^tnct rhost often refers to the time they are 
to start). Several activities are usually going on 



~ at the same time, and the day a volunteer is 
available he/she may work On several tasks in 
one gj^^more activity; ) 

• the knowledge, experience, skill, and commit- 
tment level of the^ people involved; ^ 

• the kinds of natural, local, mechanicaj, per- 

. sonal— and* whatever— kinds of events, circum- 
stances, conditions that may affect scjicdules 
(e.g., blizzards, holidaysfflfifWanicalrbceak^ 
downs, illnesses); and 

• any need to revi^«an action plan orice it has 
been developed. ' |^ 



An action plan can be used as:' 



• an outline for describing a project^ program 

• a checf^list fo^ determining progress 

• an indicator of problems, and 

• zpos^ible clue about.which parts of the plan 
need changing to correct the problems (e.g., 
X's tasks are most often done'late or wrong; 
certaiB kinds of tasks usually slow down the 
schedne). 

* ■ ■ 

An action plan should provide at a glance the informa- 
tion a planner needs. Therefore, it should fithis/her'f ,:: 
need for detail. A plan that is too broad often doesn't 
give enough information; imp^tant pieces are often 
overlooked. A plan that is too c^uiled can be over^x"" 
whejming to produce 2md to revise— and it can depress 
enthusiasm, especially among community participants in 
the project or program. Like Goldilocks, a planner has 
to try out several levels to find th^pecificity level that, 
is "just right** for a^given project. " 

The designer of a time-phased action plan must be: 

• thorough, 

• definite, but .j**- 
, • willing to revise, and above all, 

• realistic." 
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Developing aTihie-Phased Actiop Plan 

Dircctfens , ' 



1 , Read. Reference I nf ormatiofl on p^e 94, 
individOaJly. ' . ' 

2. For 5 minutes, Work with yoOi* partner sclectTng one 
of the strategies and resource inventories for two of 
the more complex activities yoir identified in Session 
8. Develop a time-phased action plan on the follow- . 
ing pages. 

Draw from vJ^hat you know about APIE County ^aft^ 
from your own background. 



Be specific as is possible and se^ms appropriate to 
. allow- the ^lan to serve all of its [Possible uses for ihe 
planner. ' " . 

' " . - ^ 

3. * If you run into_a Snag, please ask the trainers to help 

you get around iL ;* ^ - 

4. Since .this is a nrst drift, neatness does not Count - 
Don't be-afraid to add, delete, oombine, or separate 
items as you work, through the plan. juSt leave a 
little more space than you .would ordinarily to allow 
for insertions as you work. By,all m^ns, use a pen-" 
cil ^ you draft your plan. ' ^ ' ■ 
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T, The objective: -Within one year, the incidence of harmful effects (i.e., those requiring medicaJ treatmcnjrfrom 

combining alfohql and medication), wm^M decreased jjy 30 percent among the AWE County popuiati^Taged ' ; 
60 and above. ■ ^dlsr ' > 



2. The strategy sefected is. 



1 3. The activities required to implement this strategy are: 



T 



Mark #1 ifid #2, on tiae list above, the ty/o activities you 6oth select as the. basis for your time-phajed action plan. 
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.... 



5. TJst the tasks included in cii^h of the .two. relatively complex actfyiiies you t^e.s^lected.' 



Wh^^fttelTasks Are 




• * 


^ 4 ' 1, , 


•a ♦ 




4 ■ - . • . -^^ ■' •' '■ • ' 
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■ .■<^<^ ' ■ 
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. • For each activity, use the left ma«:gin to number the-tasks«'niibe Order in which thfey ire to oetur. 
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Activity #2 'Xl. ^ - • ' 


What the Tasks Are, r^^^^y-^ * ^ - 


Who Will Do them 


* * * * • N ■ ' ■ . 




■ . ■ * • . • ' ■ ■ ^ 
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For each activity, use the left margin to number the tasks in th^ order in which they are to occur. 
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The tiniestateil for reaching this objective (see #1, the objective, above) is.one year, so 12 monthiris all the tjm^l 
through December; May 1977 through April 1 978, etcJ,deM^^^^ • 




le^ anbeanv I2nioiTths [|anuafy 

Till 



For each activity, list below the tasks as you have ordered them (number 5 to bfrstarted»fic5t.^tc.). Then with the fir^t six months c i S 5^ 
the year (first column naities the first month of the project,?!;::). ■ ^^;sy-W'.:-^ ' -, - I-Ar. 

Remember that portions of different tasks can overlap (e.g, seme people -aay be making phone calls while'otheB''iik'iiintoirai^ 



FROM HERE ON, PLEASE USE PENCILS ONLY 



V 



rn = 
-2 



Take into account the results of tl)e resource inventory. Opposite each taa; number, draw a line through the)fiith(s or sans .- the momnij)} that 'the tas, 
will be happening Put an X at the end of the line to represent ampletion the task. IT IS MORE USEFtJL \WJ^' 'Wil TO DO ONB ACf IVITY 
ALLTHEWgTHROUGHCAREFULLYTHANTORUSHTHROUGH-WOOFTHEM. j,: ' 

— - ' ^ — — — ^ i^ ' ' • _ 
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Task 



1 



19 



s ^2 
13 

14 

15 

•16 

17 

1« 

19 

2D 
21 

■B 
24 
25 
26 
27 
1& 
29 
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SESSION NINE 
WORKSHEET 2 



Tirne<*Ph2sad Action ^fan fi^r Home Problem 



PJnections: 

Be as precise and as '^listic as ia>ov« la. 
hmdem Statement: ^ 




God Statement: 



Objectives: (List at least twc 
No. 1 > 




No. 2 



No. 3 • 
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Saraeap' selected for achieving objectiv*" no. 



2 



or u!i:tjvitkL< !JNillliiie ittjcai'rylng out the selected strategy: (List '^wrr below, then' number thf scqu^rrrsairy In^ 
the Icf: margir 



Use tft^uF^ inventory you develpped in Session tight for Activiti-s 1 aind 2. If you<lid not complete that exercise or 
pre^wr 0 choose different activities for your time-phasec action pian. enter them above, and use the forms on the follow- 
ing nsifes in preparing the resource inventory for them. , • 



\ 
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Activity No. 1 : 



Complete the inveaior 
paper.) 



::fte resources needea - do that activity. (If you need'more space, gse another sheet of 
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Required Resowi;;2S , ' 


On 

--^Hand ' 


• To Be 
Mobilized 


Niot 
Available 
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Rj^.quired Resources 



On 
Hand 



To Be 

Mobilized 



Not 
Available. 
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Activity No. 2: 



fl 



Complete the inventory of the resources needed to do that activity. (If you need more space, use another sheet of 
paper.) . \ 





^Required Resources ' 


On 
Hand . 


. To Be 
Mobilized . 


' Not 
Available 
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:^ 
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List scIecbyActivitv No. 1 : ' 


) ... .r .. 




■ - '1 


- / . 

. ••• 


. its tasks, fand who will dj^ach. 


Tasks 






wiio wiii>Lro 1 ncm 
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l(|^^^^ .^P2^^ 2^ thVleft, number the order in which the tasks are to be done/ * 
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' . SESSION NINE 

• WORKSHEET 2 



Mstselected Activity No. 2: _ 
•Its tasks, and who will dB eaih. 



_ .. . ' Tasks . • 


Who Will Do Them 
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In the spate at the left, number the^rder in which the tasks are to be gone. 




t '6. BetbestJtedfprreachingthisobjectivejseell.th^ 

' , (JanuaOf-'thfough December; May 1977 through ApriM9^^^ ' t 

' w I " * • 

. ^ For each aciivityjist below the tjs^ypu have ordered theiji (number'^^^ 

months of the year (first column nanitsthe.fir5t month of the project/tcj) , . 



' 1 Q. 

h, ■ 



. Remember that portions of different tasks can overlap (elg, some people may be making phone calls while others are typing something). . 

\ FROM HERE ON, PLEASE USE fEfliCILS ONLY . ^ ' ' . , ^ 

Take into account the results of the resource inventory. Opposite each task number, draW a line through.the month(s) (or part(s) of the month(sj] th^. ' 
the task will be happening. Put an X£the end,of ihe line to represent completion o|th^ Usk. IT IS MORE USEFUL IN THIS EJ(ERCISE TO DO ONE ' - 
ACTIVITY ALL THEWAYTHROUGHCAREFULLYTHANTORUSflTHROUGHTWOOFTHEM.< ' ' ■ 
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Task" 
1 
2 
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Session X 



Implementation: 
Program Management 
and Codrdination 



/ Synopsis: This session is designed to allow the planner 
to explore some management skills ilsed in implement- 
ing a community program and to explore the importancie 
of ^stablishirTg and using information exchange channels 

"^o keep aN participating parties informed on the progress 
of an established plan. The ongoing role of evaluation 
and revision is also discussed. 

Objectives: Participants will'be able to: ^ 

• describe several management skills that can ' 
assist them in implementing a planned program; 
and 



• • descrijac an Information exchange channel that' 
can be used to keep participating parties in- 
formed on the progress of an established plan, 

'Reference Information: Implementation 114 

Worksheet 1 : Management/Monitoring/ 

Supervising Skills . J. 115 

Worksheet 2: InformationrExchange 

/ Channels ^117 

« . 

■ , ■ ^ *- ■ 

/ ■ " ■ • ■ ' 
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SESSION TEN 

REFERENCE INFORMATION 



Implementation' 

Naturally^ the actual implementation tasks of carrying 
' out any project or'^program are specific to that pro- 
ject or program and so cannot be' discussed as part 
of generic planning process. However, the \nip\t' 
mentation of any program does include four aspects 
or activities that can an\j should be considered as 
part of the planning procedure. These are the 
following: 



• Managing/Monitoring/Supervising performance 
o/ assigned activities. • 

• Establishment and use of information-exchange 
xhanqels. * . ^ 

• Coordination of participating resources. 

Adjusting the designed prograrri plan .as 
necessary. 



O 114 
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'Management/Monitoring/Supervising 
Skills ' 

Directions 

^ • This worksheet contains two sections' 

• Section 1 consists of a short»seif-assessment 
qu'u on your management skills. Use approxi- 
mately 10 niinutes to complete the quiz. 

• Section 2 consists of a list of activities the 
program manager should consider in irpple- 

^, menting an alcoholism service project. 

• At the en<J of 10 minutes, a discussion will be 
convened by the trainer to ^iow you to react 
to the quiz and activities listed in Sectioij'2 
of this worksheet— or omitted from it, - . 

• This worksheet represents a Management Ob- 
jecti^je (MBO) approach. Cc isider .whether or 
not such an approach is suitable or applicable 
to your agency and the groups you work with. 



3a/ Do you keep written record of tne ^signed activi- 
ties or ta$ks> induding the anticipated comj^ion 
dates and the actual completion dates? 



ryes 



_no 



3b. If the answer to #3a is yes, are the anticipated 

completion dates and the actual corrfpletion dates: 



c) rarely close 



A v.. 

d) never close 



. a) almost ex- . 
actly the ^ 
same 

b) reasonably _ 
^ close 



Part//: Monitor^ Events ^ 

4a. When assigning tasks to others do you builc-fn 
formal checkpoints^to see how the Events are 
i ' progressing^prior to the completion date? 



. yes 



no 



Section 1 

Part /: Making Assignments 

Given a program or a task to implement, how well 
can you explain the Various parts of the program 
or task so that others know exactly what is ex 
pected of them? 



1. When you assign someone a joD, dt 
understand exactly what they are e. 

yes ■ 



ow and 
to do? 



2a. After the job has been assignee to meone, do 
^ou ask that person to paraphrase - assigned 
\ o task for you? 



_yes 



2b4. If the answer to #2a is yes, are r aracnrases 
accurate? 



4b. 



If the answer to #4a is yes, do you give formal 
feedback on whether or not events are proceed- 
ing according to plans? 



. c) rare y 
. d) never 



_ a) always 

.b) most of 
the tirfie 



A^e you able periodically to take all the parts of a 
tok or program and lay them out to determine 
tne successes and failures, strengths and weak- 
nesses, of the v/nble task or activity? 



. c) rarely 
. d) never 



.a) alw s" 

.b) mbst-of 
the time 



Are you able t keep ever )ne involvpd in the 
project/prograr-; informed ^bout the progress of 
the overall pro ect/program? 



_ a) always 

. b) most of 
the time 



. c) rare I 



. d) nevj 



.a)'alw s 

,b) mosi of 
the time 



. c) rarely 
.d) never 
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time and energy to explam to 
s zne task than it does t5 ' 
lal task? 



J cj barely 



_b) most of 
the time 



d) pfever 



8. If the answer to #7 i^ a or b, why? (Explain 
briefly.) 



t 



Part III: Management of Personnel and 
Participating Agencies 




Given :ne best plans and strateg}t5f^"great deaJ of the * 

success of the plan^ will depen^d upon your ability as a 

manager to relate to other people. 

t» - . . ' 

9. How familiar are you with theskills and abilities 



of the people who work with you? 



. a) very ^ ^ 
familiar 



. c) not sure 



Section 2 

When callexJ upon to tM^ ^e lead jpsponsibilit- to jnan- 
age'a project, or program, the community program de- 
veloper should con^idel the importance of thetfollowing ^ 
activities. , ' 



Outlming e>(plrcitly the assigned activitfes others 
are expected ^to undertake^^' * 



Getting feedback from those assigifed the^task 
on whether or not they fully understand what is 
expected of them. 



• Keeping a vyritten record of who is assigned a 
, task, the anticipated completion date, and the 

actual date it is completed: ' 

• Building in formal checkpoiVits when assigning 
iasks, to see how the tasks are progressing. 

h Providing formal feedback to thoselvho arenas- 
signed fhe task whether or not the tasks are pro- 
ce^ding according to plans. 



_^b) familiar 



.d) not familiar 
at all 



10. How often do you give positive feedback to a staff 
person" or participating agency for a job well done? 



• Per oaical ly taking all parts of a task, project; or 
prostram and laying them out to determine the 
successes and failures, strengths and weaknesses 
of tre whole project/program. 



a) very often 
. b) often 



^(^) seldom 
_d) not at all 



11. Do you provide written positive feedback to staff 
or particiiSi^ting agency on occasions other than 
their formaTevaluations (e.g., letters of 
commendation)? 



» - Keeping everyone involved in the project/ 
program informed about the progress of the 
overall project/program. 

• Being able to assess the skills and abilities of 
the people who work with you. 



2l) very often 
_b) often' 



_c) seldom 
_d) not at all 



\ • Providing positive feedback to people for jobs 
well done on occasions other tn&n for^ra evalua- 
tions (e.g,, letters of cBmmendation). \ 



n6\ 



I 



• at 



Inform! 



-mation-Ext 



Exchange Channels 



Directi^s 



THis worksheet introduces an information-exchange sys» 
tem,lha5t cah assist in keeping program participants in- 
formed on how a (snroject or program is proceeding. 
Tljere is nt) pqint in completing tffe worksheet di^ring 
• the training piiogramr; it is to be real! ar)d discussed for 
^(|?plicability iryyour own agency. ^ 

Step^l : List all participating agencies 6T*groups.and 
briefly list their activities and the anticipated 
completicJn date of each. 

Step 2: HaVe each agency or group briefly list the 
tasp i^ engaged in most recently while pro- 
ceeding toward the completion of its assigned 
activities. Also have each agency briefly state 
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^whether it is proceeding according to plans or • 
encountering difflculties. ^ • 

• V A- 

Step 3: "^Ir^foron each participating party how^any 
/ copies of its reports are needed, and when, 

wh^re, and 'to whom they are tt>^be suBtnitted, 
^ Aiso^ncourage each party to^ maintains folder 
^f all reports iFrom other participating agencies 
or organizations and brn^g it to scheduled 
lee tings. 

Step 4: Schedule periodic meetings of all participating 
^parties. Prepare and circulate agendas in 
\dvance. ^ ^ 

Step 5: As the coordinator or^tearrf leader, or program 
manager, be sure to keep an up-to-date file on 
all reports and have a supply of blanK forms 
fordrstribution. 





/ 




Folhi 



^Report for ^ 

^ w^- * |montlii,year)' 



V 



)rgaliization) 



CoWtPenon; 



~7— 
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.x\ ' j/, Activities . f,/ 

i ^ ' 


^ Completlflii Dates ♦ 


y fijIttAccojjipliiihed- ^ 
TbDate- ; 


; • ' • Probfems'^ ' * 
Encountered . 
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SAMPLE INSTRUaiONS: 



Each agsnci or gl-oup is responsible f6r sending three copies of its completed form to the other agencies by the 20th of each month. A debriefing meeting will Ije'v 
held on Jie last working day of each month. Each contact person or a representative should attend that meeting. 
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Synopsis: This^ si^ssion focuses the participants' atten- 
tion on the need for conducting an evaluation of the 
progrifn devebped. It brings together many activities 
that welrc considered in earlier sessions and shows how 
they relate to and centributc to the evaluation effort. 
Suggested techniques for conducting infbrmal, Indirect, 
or process evaluation are offered aJ6ng with guidelines 
for Selecting an evaluator to assist in the design and 
execution of their back home evaluation effort 

Objecthres: Participants.will: 

• identify three reasons for program evaluation; 

• identify three noftformal approaches to pro- 
gram evaluation; 

• complete an evaluation readiness checklist; 

• lisi one advantage and one disadvantage for 
each data-gathering technique described in the 
session; 

• list three advantages andfthree disadvantages 
of using an outside evalt^tor; 

• complete a set of evaluation worksheets for one 
objective of their back home problems;. ^ 

list three steps that would increaseXthe obje^ir- 
tJvity of their evaluation effort; and 



list three planning activities that would porf- 
tribute to the effectiveness of their program , 
evaluation. v 



■Reference Information: Reasons to 

Evaluate, . , , 121 

Reference Information: Approaches to 

Prbgrar^i Evaluation ^ 122 

Reference Inforrti^tion: Brief Summary of 

Common Evaluation Techniques . . . f . . . 128 

Worksheet 1 : An Evaluation ReadiAe^s 

Checklist 130 

Worksheet 2: v^valuation Planning Sheet One . . 131 

Worksheet^: Evaluation Planning Sheet Two . . » 134 

Worksheet 4: Taking Stock of Evaluation 

Planning . * 136 

Reference Information: Evaluation Data 139 

Reference Information: Use of an Outside A 

Evaluation Consult^! * T40 ^ 

Reference Information: Objectivity/Planning 

Suggestions for Evaluation Methods ... 141 
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^ * ^ Reasons to Evaluates 

of aljy.^ogr^^ft t)ejng proposed, v *" : 

' • ^ ^ First, tfif ev^lUatio5 ci> assistthe^^a^ncy in "deternjlnlng 
^ ' whether or not the prografn-bbjecttves wefeTnet. The' • 
cjflcn t to which in eyal^ion effoiTlaq ass/ii jpt deter- • 
rmhlng thc/effectiveriess of a prograVin attaining its ^ 
* object Is^dirtq^y related to how cleariy the'bbjectiver6f 
the prograrn l^c been defined. ^ ' \ 

Second, program cvaljl^tion can help pinpointi^t only 
the weakr>esses of the program but also its^trengths. 
Such an identification is helpiful in revising the program 4 
J ^because it provides the factual informatiQn upon which 
a program* director can b&e those decisions. Perhaps * 
funds or pefjbnnel could be added to stren^tlfen a 
weak area or perhaps" that area shoold-be dropped from 
the program. Whatever the decision, it is best made with • 
information collected. specifically to answer such 
questions. 

Third, program evaluation can help determine whether a 
program is costing too much in relatipn to'the benefits 
derived from the program. Special care must be Uken in 
deciding this when dealing with social problems; there is 
often a tendency to rely too heavily on , what dollar fig- 



^ urcs^y, focgctting tha^therimportant factors or bene- 
\ frteJsliouJd betaken irvto consideration. ' : ' j 

Fourt*C^aluatJon data can serve an Effective public 
y felaj^ions fyncti»o by pfovTding theVrggrahx direqlor- 
-wipi tiit^n^rm^tion ne^ed^o ju«ify>ti^e continuation 
' *or«>(pansioh oith€ prograi]fi', Sdch informatiofi candle 
^Jnv^luable v4fen\dcafing v^wj^uT^Mc or,privatfe officials'^ 
^ who have some fay aS to the hione^a program v^ll be 
aHotte'y from tQe budget they QpniroL 

Fifth, likd^niany other^spects-pf the fanning prbcess, ^ 
designing and-carrying.but ptogram evaluation requires 
much morQithan can be provide^in this single session. 
In other portipns of the trainfrig program Sn which- 
evaluation issues and activities<were dis^sse^ it^js " 
reco/nmertded that persons whajre qualified and ex- 
perienced in program evaluation be used as consultants.^ 
That Fecommendation is repeated strongly here. When 
a planner depends^on evaluation data to indicate the e^ 
fectiveness of a program, it sjands to^eason that the 
' design of the evaluation 'instruments, meth6dolog^(^d 
the evaluation itself should not be left in the hands of 
amateurs or be based on trial and error learning. 

^ . - 

Furthermore, it is usually very difficult for a^erson who 
has other sigh'rficant ties to^aj)rogram to overborne his/ 
her personal or professional involvements and become as 
objective as an outside evaluation Consultant generally 
can be. ' » ^ 
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REFERENCE INFORMATION 



Approaches to Program Evaluation 

The evaluation compohent of this training program 
focuses on action-oriented, applied approaches to evalu- 
atfop^fatner that^Qn formal evaluation or research- ' 
Inenttd evaluation. JBoth approaches to evaluation. are 
Cfftlrely l^itirhatc; they differ.basically, however, in 
their intended purposes. ^ 
. ■ • -* 

Formal evaluation or research may, incidentally, yield 
some practical application, but its primary purpose 
is usuifly to aid in (he formulation of abstract pre- 
dictions. The number of variables over which the eval- 
uator has control is typically greater in formal eval- 
uation than it Is in infornial or action, evaluation. 
Similarly, the degree of control over the variables 
is mc/e stringent in rescaj^^p^ormal evaluation. 

Because >this trairiing program fs intended for persons 
actually working in the alcoholism services field, re- 
search or formal evaluation is not discussed further 
here.-. Instead, the content of this session centers on 
achieving an action-oriented, practical evaluation goal; 
namely, to provide information for progrant planning, 
development, or operation. Three approaches to this 
goal are discussed briefly below, together with some 
data collection techniques appropriate to each. Sonie ^ 
of the techniques were touched on in the assessment \ 
component of this training program. TITey are repeated 
here because their usefulness is by no means limited to 
the collection of needs assessment data. It should be 
noted that the techniques mentioned can also be used 
In gathering research or formal evaluation data. (See 
Appendix A for references to books on evaluation.) 

informal Program Evaluation 

V^hat are the main characteristics of information 
''program evaiuation? 

• Informal program evaluation is u^in a set- 
ting other than a formal research study. 

• It gathers and analyzes information about a 
program in its functiortal setting. 

.-• It uses varioi/s methods/ techniques, and instru- 
• ' ments to focus the information-gathering pro- 
cess upon selected aspecj^of tl^ program. 

• — The construction and use ofWch instruments 
provides V^ommon basis for comparing the 
responses of different individuals or other 
kinds of data sources related to the program 
* or involved in it. 
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What are some common, usefui techniques and 
Instruments to use in doing informdi program 
evaiuation? * • 

Four mean^ for gathering program evaluation informa- 
tion that are discussed here are: usin^questionrUM'res 
and checklists, and conductirrg interviews and obser- [ 
vatibns. They have been touched on in thfe assessment, 
component, but further important comments are intfo- 
'ttoced in the context of planning for program evaluation. 

Questionnaires 

What shouid a planner or evaiuator be aware of 

using questionnaires? 
f ' ■ ~ ' 

• A questionnaire is basically an at^mpt to 
standardize a set of qoestions about a particu- 
lar topic. 

4" 

• The topics of the questionnaire may be opin-^ 
* ions, feelings; and attitudes Of the/ may be 

^ cognitive or factual in nature, for fexample, ^ 

— "How do you feel- about third party pay- 
ments?*' "What do^iL think of giving money 
to a panhanlflec^ho obviously has the 
shakfes?"' X,^^ 

- **H(iw many -clients entered the Riverlet 
Treamieat-Genter during the month of Aug- 
ust]/ "What credentials does this agency fe- 

. quire its alcoholism counselors to have?" 

• .Ordinarily, questionnaires are regarded as self- 
reportij^g instruments which may therefore be 

■ subject to the4"espondent's distortion or to 

misinterpretation. 

- The^espondent to the questionnaire answers 
the questions, (usually in writing) without the 
benefit of feedback of his/her interpretation 
of the question. 

— Therefore, it is imperative to nriake the ques- 
tions as clear and precise as possible, 

What two basic types of questions are there? 

\ • Questions used in questionnaires can be "closed- 
ended" or "open-ended" questions. Aquesr 
tionnaire may consist entirely of one type or it 
may be a mix of both types. 

• . Cl?)sed-ended questions are those in which the 
^evaiuator (and/or questionnaire designer) have 
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deliberately limited ti}e possible responses. For 
example,. 

- "Check whether you agree, disagree, pf^-are 
uncertain about this item or poxnlJ/ 

- "Does your agency regularly 
parking for volunteer workei 
Yes ; No „ 

- ^"What hours is the clinicopen on Saturdays?" 

• Thi trick with closed-ended questions is to make 
as certain as ^iossible that thrright questions are 
asked and the right answers 'are provided for . 
respondents to choose from. £ 

- What is "right," of course, goes back to the 
reason for which the question is being asked; 
i.e.. What is the purpose of this evaluation 
activity? Who will use the daU to make what 
decisions? * • . 

• Opcn'«nded questions do not restrict the possible 
responses. They are often used lb gather infor- 
mation on topics which may be somewhat af- 
fectively or subjectively oriented, or are other- 
wise unclear or loosely delineated. They repre- 

^ sent an unstructured exploration of a topic on 
which responses may vary greatly becausfe of 
differences in feelings and/or experiences. . 

— Well phrased open-ended questions can pro- 
duce a range of information from the persons 
questioned: a kind of respondents' self- 
identification of what they want to say on a' 
topic. 

• The difficulty with open-ended questions, how- 
^ ever, comes in classifying and coding them, and 
also jn interpreting the intensity of^e 



responses. 



- Every respondent is likejy to^l^e a some- . 
what unique tack on open-ended questions, 
so trying to identiify trends among all the 
respondents can be a demanding task for the 
cvaiuator. ■ ■ 



• Efther a face-to-face or telephone interview al- 
lows the interviewer to adapt ^e level of focus 
on a particular topic to the capaftllity of the 
resp9ndent to answer, 

~ For example, questions can be rephrased; 

— additional details or clarifij^tion can be 
asked for; or errtotional tones can be re- 

.ponded to. . 

• Because there is direct interaction between the 
interviewer and the respondent (whether irTper- 
son or by phone), the interviewer can note a 
number of incidental or extraneous behaviors 
and emotions which are not a planned part of 
an interview, but which may assist the evaiuator 

' in analyzing and interpreting the solicited inter- * 
view data. 

- For example, "Most people^had difficulty in 
ur^erstanding Question Five." "At least half 
the people wanted to know whether they had 
to answer Question Nine. *»"Severai re- 
sppndents thought that Questions Eight and 
Fourteen were the same." "Generally, 
people paused a fairly long time before answer- 
ing Number Six.": 

What are the two basic types of interviews? 

• Interviews can basically be classified as either 
"structured" or "unstructured" interviews, re-_ 
gardless of the nriedium through which they are 
conducted. * \ . ^ 

• Structured interviews are ones in which each 
question is carefully worded, and the interviewer 
is required: . 

— to maintain precisely the wording of the ' 
^' questions; and 

— to ask the questions in the exact sequence 
provijded in the questionnaire. 

• Although it might seem easier to conduct a 

^ structured interview than an unstructured one) 



that is not necessarily so. 



V 



Interviews 



What art some characteristics of interviews? 

An interview may involve either face-to-face or telephone 
contact between the interviewer and respondent 



— Respondents sometinies provide more infor- 
mation than a questionTasks for. They may 
resent being asked a later question which 
covers the information already given. . 



— Interviewers to whom this happens some- ' 
times resent "appearing stupid" by having to 
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ask for information that the respondent pre* 
viously volunteered. 

• Unstructured interviews permit the interviewers 
to change the wording or sequence of the ques- 
' tlons in adaptation to the response potehtial of 
the respondents. 



Possible dangers which must be guarded against 
in unstructured interviews are wandering off 
th^ topMljtf concern or failing to ask about 
some (^Hpi altogether. 



To avoid these possibilities, even persons 
conducting unstructured interviews syste- 
matically use interview ihstruments such-as 
. guides or checklists to ma(ce certain that no ^ 
predetermined data are omitted. 

Oiecklists 

• Checklists have many uses in the planning pro- 
cess, but they are especially helpful in carrying 
out prograrn*evaJuation procedures. 

What are some advantages of using checklists in 
program evaiuation? ^- , 

• Checklists can be presentedJn quite simple ' 
formats. 

— Therefore/they can be used quickly and 
easily., N;^ « ^ 

— The data recorded on checklists can be easily 
tabulated. 

• Checklists are particularly useful instruments for 
recording the incidence of sUch diverse data as 
attitudes, feelings, behaviors, skills, and events. 

• TKb key point in designing a checklist to use in 
prograhfi evaluation is the realization that the - 
apparent sinfiplicity of the final product(s) is 
usually the result of a considerable amount of 
planning, designing, and redesigning. 

— A checklist of the items which collectively 
define the parameters of certain tasks, feel- 
ings, or events requires a thorough examina- 

'^tion of what items are th^ subject opmerest 
and how they wil| be identified. 



• Since checklist Items require only a check mark 
or a simple yes or ho answer, the evaluator 
.Should exercise restraint in the number of 
items to be checked. 



- Each item response requires some degree of 
judgment and perhaps decision making. 
Therefore, more is asked of the respondent 
than mere marks on a paper. 

The efficiency of a checklist, and probabFy 
the effectiveness of the responses, can be ad- 
versely aipfected by checklists that are too long 
or detailed. When that happens, the major ad- 
vantage of using a checklist is lost 

^ The major disadvantage of a checklist is the very 
limited amount of information provided by the 
responses. 

« 

— There is no opportunity for respondents to 
quajify their responses. 

~ A checklist is closed-ended; there is no op- 
portunity for the respondent to volunteer 
additional information. . 

Observations' 

What characterizes obsen/ation as an evaiuatiort 
technique? ' ' 

• When used in program evaluation^ observation 
must be organized, directed, systefitatfc; and 
recorded. , 

' — ThA is, when the pur|3pse of observation is tb 
gSner ph)gram evalua^on data, observers do 
/ not simply "keep their eyes open" to what^ 
'happens or does not happen. ^ < 

• Observation as an evaluation approach can be 
either explicit and openfy acknowledged, or un- 
obtrusive and covert 

— An observer may spend a day in the feception 
room of an alcoholism treatment agency^ 
Those who pass through the ropm may or 
may not be told^that he/she is an observer, 

\ ^ and what is being observed. - ? . 

• Regardless of the purpose of the observation, four 
basic questions should be answered in evaluating 
by observation. 

— ^What is to be .observed? (E.g., What data are 
to be collected and how much of hi) 

— How will the observati0n(s) be recorded? 
(E.g., What instrument(s) will be used in re- 
cording the data?) - 
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^ - What mctho* Will be used to maximize the 
accuracy of the observatk)n(s)? (E.g., Will 
several observers be used? Hoif often will ob- 
servations be made?) 

- What relationship should exist between the 
observer and the focus of the observation(s)?'^ 
(E.g., Should the^bject of the observation (s) 

• be aware of the observer and his/her role and 
function? Should the observer and observed 
interact; if so, how and to what extent?) 

• Observation tells what happened or occurred 
(or what did not); it does not tell what tiiose 
events or occurrences mean. 

- At best, observation provides a sampling of 
selected events over a period of time. 

- The significance of the recorded events or 
behaviors must be interpreted by the evaJua= 
tor, often with the assistance of the observer. 

• The way the categories of evehts or behaviors 
identified for observation are structured influ- 
ences gre>tly the inferences tiiat can be made. 

- The mor^ highly structured the categories,' 
. the fewer inferences) can be drawn. For ex- 
ample, for tile category of the ^Veception- / ' 
ist's greeting of entering clicntt," an ob- 
server would probably note tiiat hef^he does 
greet tiiem if a simple "Hi or Hello" is uttered. 
However, unless the fategory is structured to 
include other appropriate receptionist be- * , 
haviors (e.g., offering a seat, coffee, or other 
assistance), it could not be inferred that the 

* receptionist was fully or"tffectively carrying 
out that role. ' 

- Unstructured observation categories do allow 
"c, for a wide range of inferences that may be 

• desirable under certain circumstances; e.g., 

tlie observation of the general climate or. 

flavor of a situation. 
« 

> Unstructured observation, however, because it 
is sp dependent on the ob"server(s) rather than on 
set procedures or strict categories, often gener- 
ates serious problems of observer reliability. 

— ' Human observers do not operate like cameras 
or tape recorders, Uklng in all the discrete 
stimuli within their purview. 



- They have biases, interests, and emotions 
which can limit, if not actually distort, what 
. they consciously observe^ 

Observations are usually written as notes and/or 
as marks 6n checklists, or sometime they are i 
spoken directiy into a tape recorder on the spot 



Indirect Program Evaluation 

. Wfyat are the characteristics of indirect program 

evaluation? * 

- >• . ' • . 

• ' Indirect program evaluation (often called 

"unobtrusive measurement") does not require 
' the cooperation of the program participants 

^ ^, . 'in collecting the evaluation information. 

• Indirect evaluation approaches or methods do 
not intrude on or interfere with the data- 
gathering process, and therefore, they do not 

/influence or contaminate the data which is > 
gathered '(e.g., counting the number of alcohol 
information brochures taken from'S'lobby 
table in a teen center during a particular peribd 
of time). - 

What are- t\yo common approoches to indirect^ 
program evaiitation? . r / ^ ' 

Using records and observation rx\trM6^.^j^l^^ :• 
common apprpVhes to indirftcfprogr^ fval^ife Vi 

Records - . ■ '.r^'^'^:^-^%\y'-r r'^r;:' 

■ ' ' '' C' -y' v^-'^^ 

• Keeping and/or'exai)f»ming records can be • 
identified as one indirect approach to . . 
evaluation. 

, - Por'examp/e^ records \Yl|tich can b 

lated without involving tii^program partici- 
pants in compiling them can be one source of 
indirect evaluation data. That is, records of 
who attends scheduled meetings of the pro- . 
gram planning groups; newspaper accounts 
, of program activities; the number of people 
^ at meetings who come late and/or leave 
eariy;etc. 

— ''Smiilarly, a great deal of information relevant 
to an alcoholism services-related prpgran) has 
, already beeq collected by^.other WDple for 
other purposes. DaU from other agencies, Hi- 
stitutions, and organisations (local, state, and 
national) can be examined and considered in 
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relation to data gathered specifically for the 
program to/be evaluated, and therefore, tied 
to Its objectives. For example, if an alcoholism 
program's/objectives include the reduction of 
car wrecks involving teenagers who had beeh 
drinking/ the inspection of standard police ac- 
cident ofcords could provide valuable indirect ; 
informa 



Observation^ 

What Is the rSle of the observer in an indirect 
evaluation approach? 

In/indirect evaluation, ^e observer often as- 
imes a passive role. 

^ He/she does not participate in whateveHs 
being observed. 

Sometimes in gathering^unobtrusive measure- 
ments, it is appropri^tfi^^for. the observer to be • 
concealed: or not identified as an observer. 

— This must be handled carefully as it mayj)e 
seen as a violation of prograrti participants' 

/ privacy or as a deception. 

Qo^ionally, the observer is identified as such, 

• hilt the ^us of the observation is misrepre- 
, ienteapyS^ identified, (e.g., saying that 
[ jfijie^ to the presenting prob- 

V- whereas the true focus of evalua- 

• tion data is the age, race, or neighborhood, etc. 
rpi the clients). \ 

— Again this must be done cautiously, but its 
' : advantage is that the focus of the observa- 

' I.. ^ tion is much less likely to bQ contaminated 
or distorted by the observation process. 

V^hatare some common indirect indicators used as ■ 
the focus of observation(s) in indirect evaluation? 

. • Concrete physical signs, such as clothing, hair, 
J general appearance, jewelry, types of houses 
; lived in by the subject of observation, etc. " 

° • Expressive movement such as nonverbal cues 
(e.g., nodding, scowling, gestures) that the 
subject exhibits. 



Physical location as such, how the participants 
group themselves during formal and informal 
program event?. ^ 



• Conversation sampling such as the type and 
frequency of agreement statements, as well as 
who makes them on what topics. 

• Time duration, or the amount of attention paid 
: . by a person to a particular ob^e^t or activity. ' 

What are some additional cautions about 
indirect evaluation? *y 

• It is unlikely that the exclusive use of indirect 
evaluation methods could meet all of the 
evaluation needs of a community pro^^ de- 
signed to develop or expand alcoholism-related 
services. 

P It can, however, be particularly useful: 

— when the focus of observation is a sensitive ' 
or awkward one; and - ^ 

— when there is need or desire for additional 
or ancillary data that might help to explain 
or clarify other^data. 



Program Process Evaluatio^i 

When and why is program process evaluation used? 

■ > 

• Process evaluation fs used to gather information 
during the implementation of^ program. 

— It collects data ph hov/^losely the program 
is being carried out in relation to its design 
and schedule. * . , 

- The data on departure(s) from the program 
^ design and schedule are used in making de- 
cisions regarding modification of the 
program. 

What are some aspects of one major approach ip 
process evaluation? ' v , 

• Schedule observation is a major technique for 
doing process evaluation. 

• Ir^schecfSle observation, the main function of 
the observer is to monitor program events to see 
whether and to what extent they deviate from' 

« the originally planned program. 

• The purpose of schedule observation is not to 
insure adherence to the proposed schedule but 
to note instances and causes of deviation. 
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• This information contributes valuable data for 
making prpgram revision decisions. , 

Combining Evaluatfon Approaches' 

It is generally acknowledged that the more ways of 
looking at something, the better the picture of the sub- 
ject In a simiiar way, employing one evaluation ap- 
proach limits pbservation of the subject to one per- 
spective. However, if a variety of evaluation appjoaches 
Is used to examine a program, the information gathered^ 
presents a composite view more repra?entative of what 
is actually happening in the program. .It is therefore 
strongly recommended that an attempt be made to emr 



plgy some connbination of the three approaches de- 
scribed above. It is, of course, unrealistic to attempt to 
use allof the evaluation techniques listed above. The 
amount of money, lime, and the level of experience 
brought to the evaluation activity must all be considered. 

Observatioh as an evaluation technique is used in all 
three approaches. Since it is the most common way to 
gather evaluation data, particular attention should be 
paid to the suggested procedures for gathering informa- 
tion using this technique. Advantages and disadvantages 
of using bljservatiorr as well as other common evaluation 
techniques are presented in a table on the following two 
piges. 
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Brief Summary of Common Evaluation Techniques 



TcdiniqiKS 



Questionnaire 



Interview 



ChecKlists 



Observation 



• greater refiabiiity with closed-ended 
questions ^ 

• ifanon'ymous, may encourage honesty 
and frankness of response 

• economical in time and money 



• allows flexibility in wording and sequence 
of questions 

• provides time to explore, probe area of - 
interest 



• simple format ' 

• easily used by untrained personnel 



• provides record of .what actually happened 
ordidnotfippen 

• independent of the subjects' willingness to 
'respond 

• Observer can relate what is happening to 
. the objectives of the program , 



ysatlYantages 



• low percentage of returns when maifed 

• structure eliminates possible alternate 
■ responses 

• uniformity of data may be misleading- ' 

• 'requires skill to construct properly 



• time consuming to conduct 

• information obtained is dependent on 
skill of interviewer 



• often limited to specific behaviors, 
sequence of events, etc. 

• construction requires care 



• cost in observer time is high , ' 

• observer may have some degree of 
impact on situation z^, 

• must be selective (can only look at a' 
certain number of categories or events) 

• obse'rvers operate from biases 
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Records 



Observition 



• are provided by other sources (less cost) 
•■ .areoftenapartof the programorcan . 



easily be added 
• may be permanent 



• see Informal Evaluation , 

•. appropriate for group situations \ 

• avoids or decreases contamination 



• may be time consuming to search 
--through records|requires selectivity) 

* a high degree of inference may be 
required 

♦ , may violate confidentiality 



• should not be used as sole means of 
evaluation' 

• high degree of inference required 

• may be viewed as "spying" 



Webb, Eugene j.,'DonaldT. 
Campbdl, R.D. Schwartz and 
L. B.Sechrest,Wirus/Ve 
Memres: Sonreactive Re' 
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Schedule 
Observation 



• see comments under Informal and 
Indirect Evaluation 

f easy to observe 

• criteria usually readily available as part 
ofprogram.<lesign 



• see.comments under Informal and 
Indirect Evaluation, 

• danger of letting the schedule become 
major criterion ■ 



\ 
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JSESSION ELEVEN 
WORKSHEET 1 



An Evaluation Readiness Checklist 



If you can answer YES to all of, the questions listed betow then you are sufficiently prepared to initiate evaluation 
planning fof* yoUr program. This session focuses on those questions not covered in previous sessions with heavy 
emphasis on questions 5 and 9. 



Directions: Indicate your response to each of the questions listed below by placing a check in thje>ace provided. 



Question 



Response 



HAV6I DETERMINED: v 



YES NO 



1. Whatisbeihgevaluaitedr - * \^ 



What is the purpose of this evaluation? 



3. What are the program goals? 



What are the program objectives? 



5. What kind df program evaluation (i.e., indirect, informal, or pro^s) will yield the most ' 
f useful data? j?^ 

6. - How will results of evaluation daU be -used? , . * . * * . ^ • 



7. What resources are available for evaluation? 



S.jip • How much time is allowed for the evaluation activity? 
^ ' 



Wh^ill conduct thfe^evaluation? 
A) ' In-house person? 



B) Outside evaluation specialist? 



/ 



^33 



/ 



ERIC 



130 



\ 



SESSION ELEVEN 
WORKSHEETS 



Evaluation Planning Sheet One • 

Directions: ^ ' 

Working indtvidually^ study the completed sample for 
Worksheet 2* on page 132. Then complete Worksheet 
^ 2 on page 1 33 as follow^. 

1 . Under "objective" enter the objective to be evalu- 
ated, including measurable terms. (Use an objec- 
tive* devdopetj for ^our back home problem.) 



I- 



Under "criteria" indicate: 



• source of the information; 

• date on which information will become avail- 
able concerning, the objective; and 

• who will provide the needwl data. 

r' 

Under "target completton date" enter the time 
you/anticipate will be required to achieve the 
stated obje ctive. ^ . 



4. Under "problem addressed" make explicit the link 
between this objective and the program needs or 
problem statement. » 



5. Evaluation resouroes may be available in-house or 
require outside consultant expertise. 

6. Indicate yes or no as a response for«the objective. 
Lirtk the objective to the program's overall goals. 

7. Enter interim evaluation dates. 

8. List interim evaluation measures. 

After cbmpletmg the steps above, ask yourself: 

Is the objective measurable? Is the objective 
time-limited? Is it realistic, given available re- 
sources and program policies? ^ 

Then discuss with the group how to overcome problem 
a|eas and reformulate a workable objective, if necessary. 



♦Worksheets 2 and 3 and their accompanying instruc- 
tions have been adapted from Fuhdamentals of Program 
Evaluation: Trainee's Resource Manual, developed by 
the National Drug Abuse Center for Training and Re- 
source Development 1901 North Moore Street, 
Arlington, Virginia 22209, 1977. 
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Sample Evaluation Sheet One 

' AjMcy: EllenbuijAlcDteliini Treatment (inter^^ 

• • ■ ' i 

Propm Goal: To upgrade ski|ls of alcoholism counselors serving clients in this center. 
Who WillUse Evaluation Data; Center Director and Training Consultant * 
ftirMj) of Evaluation Data: To monitor change in#e supervisors npn^i spending in clinical 



m 
z 



inical supervision of alcoholism counselors. 



HI 



Objective 



All counselors 
will receive 

clirucai super- 
vision tim<^ , 
from their ^ 
clinical (. 
5upe(visor$. 



(2) 



f 

Criteria 
for. 
measuring 
objective 



50% Increase 
from.6/30/77 
as indicated on 
weeklytime 
sheets of 



(3) 



supervisors. 



Target 
completion 
date 



6/30/78 



t 1 






Are ' 




the 


Problem 


' resources 


addressed . 


available? 


Poor quality of 


t 

Yes-within 


counseling re- 


'capability of 


ceived by 


liresent training 


clients. 


suff. 1 
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■ (6) 
Jsthis 



consistent 
with 

program ' 
goals/ 
policies?' 



Yes 



Interim 
valuation 
: dates 

1)30/78 



Interim 
measures 



inationof 
weekly time 
sheets. 



Evaluation Planning Sheet One 



AGENCY: 



Jr. 



V 

PROGRAM GOAL: 








5 ' 

4- 






1^ 


















WHOWILL USE iVALUATION DATA: 
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PURPOSE(S) OF EVALUATION DATA: 
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» program 
goals/ 
• policies? 


Interim 
evaluation 
dates 


Interim 
measures : 
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•Evaluation Planning Sheet Two v 

Directions: • | % ^ 

I Study the sample on this page. ' 
1 On the next page, write a bacic home goal statement, an objective for it; a^ 

3. Next enter one or more data collection methods that appear appropriate for the strategy. Keep in mind the purpose of the data in relation to 
the type(s) of data you can actually collect; the time/equired to collect^the dat^the obtrusiveness of the proposed collection me.thod; etc. 

Entertheprojectedoutcorne|i.e.,anticipatedresult(s)foreachmeaa)rementme^^^^ ' ' ^' 

I Finally,i|ate explicitly any assumptions or Ipgical steps that have been irpplicit until this point. 
^ Repeat the process for each objective. P , 



ri/>S 

mp 
Hm 
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m 
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Program Goal Statement:-#mbers of the Ar^^ clergy will broaden their assistance to people who seek their help for alcohol-related problems, 



Objective 

r 


, Measurement method' 


Projected outcome 

_i_ \ 


Meaning of outcome in meeting 
programgoal 


By 6 months after program 
implementation,,'to increase 
by 5054 the number of r^ . 
ferrals made by Arlington . 
clergy to 20 service resources 
that assist alcoholic persons 
and their families. 


'\ 

a) Questionnaire • 

v 

b) Interviews 

: - ' f 


a| ';lndication of how many referrals 
were made in six-month peng/ 
a;id to which service resources. 

b) The 10% of clergy men whore- ' 
ported the fewest referrals will 
be interviewed to determine why 
they did or did not refer peqple 
to alcoholism service resources. 


a) A determination of whether or not a 50% increase 
in referrals was ^omplished compared with 
baseline data. 

b) W/hether there is a need for further efforts to en- 
courage, clergy members to make additional use of ' 

^' alcoholism service resources and if so, how this 
might be done. 



V 
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Evaluation Planning Sheet Two 



PrognmGoalSuteflient: 




^,Objective 



ERiq 



Measurement method 



Projeciled outcome 



r 



Meaning of outcome in meeting 
program goal 



■I 



m 



SESSION ELEVEN 

WORKSHEET 4 ^ 



Taking Stock of Evaluation Planning 



The training program has emphasized repeatedly that the planning process requires-and to a certain extent benefits 
from-interaction and cooperation with other persons and groups. This, of course, holds for planning and designing 
the evaluation component activities. Other people who are reasonably familiar with the topic being evaluated fre- 
quently bring fresh insights and suggestions. This exercise provides an opportunity^or that to occur again in relatiori 
to planning evaluation of your back home program. 

Dirsctions r . 

1 . Select a person to report thc^ small group's problems and questions to the large group. 

2. . Individually complete Step$ l and 2 below. 

3. ^ Then as a small group work through Step 3, being frank about your questions, contributions, concerns, or 

uncertainties. • - 

4. Reporter prepares a summary of Step 3 outcomes. 

Step 1 : Using the space below, rank the evaluation methods for each objective in priority order in terms oUheIr ^ 
ability . to Indicate v/hether program goals have or have not been met. Eliminate methods that do not provide 
outcomes that tell you something about the extent to which program goals have been achieved. 

Objective 1 Objective 2 / Objective 3, etc. 



f 



I 



SESSION ELEVEN 
WOMCSHEET 4 



Step 2: For each evaluation method, identify the potential probleys it may poise .to the program when (mplemented. 

■i , " 
Objective 2 



List problem areas. 
Ob]ective 1 



Objective 3, etc. 



Step 3: Do you want to change priorities or eliminate any metxiods? Be careful not to eliminate any methods too 

quickly. Discuss your assumptions with others before eliminating a method. Are your assumptions realistic? 
List below your final priorities among program evaluation approae^i, techniques, or instruments. 



SESSIOrrELEVEN 
WORKSHEET 4 



Step 4: As the reports fromieach group are made and you receive comments about the concerns, assumptions, etc. • 
^ / * from the large group, use this space to make notes about topics or4)oints you may want to follow upofrwith 
your evaluation consultant when you are working on the plan for evaluating your back home progrm? 
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SESSION ELEVEN 
I REFERENCE INFORMATION 



Evaluation Data 



What To Do with the Evaluation Data 

The foJ^Wmg steps outline a process for arranging col- 
Jccted -evaluation data in a way that facilitates inter- * 
pretatioh. The process Is simple but time consuming. 
However, the vaJidity of conclusi6ns depends on how 
accurately these steps are carried out.* 

• Each set of the responses from observations, 
. , completed questionnaires, interviews, etc. 

must be examined for patterns among the 
responses. 

• Categories should b& identified under which 
the responses can be summarized, 

• Under each category, all the responses made 
that fit into that category shquld be Hsted. 

• For each categoty, the above list should be 

^ edited to elinjkiate" duplicate kinds oiF responses. 

• A short summary of the most imp<irtant items 
under each category should be prepared. 

Some Do's and Don'ts of*Eva|uation 
D.ata Interpretation 

Regardless of the quantity and quality of data collected, 
the value of the information can be confipletely negated 
by tKe way , the data are interpreted.' The following 
guideline will assist in interpreting the information 
collected. 



• Do nol conclude that an observation made by 
only orie observer is inaccurate. 

• Do not take comnrrents at face value (consider 
thCoOOntext in which the comments were made; 

^ e.fr, body language, time oftiay, sequence of 
questions; etc.). * 

• Do "Oj^p to considei?the individual perspec- 
tive.nW tpespbsetver. • 



Th^o's 



f 



The Don'ts 



f 



Do not assume that consensus &mong one 
group of observers (participants, trainers, ad- 
ministratorj, etc.) guarantees acciitat^ 
judgment. 



» Analyze the summary statements for the various 
aspfects of the pilot program derived from pb- 
^rvations.' Prepare a brief statement describing 
their meaning(s) and possible significance. 

I Prepare similar descriptive statements based on 
the summaries of other evaluation techniques, 
such as questionnaires, testis, interviews, etc. 
Each evaluation technique should have a sum- 
"^mary statement. % 

> Compare the summary statements from the dif-^ 
ferent evaluation approaches on]y when they 
deal with the same aspect of the program. Look 
for areas of agreement and disagreement. When 
compalStig data in this manner the evaluator 
should be sensitive to such things as differences 
in nuances of language as well as* the various 
perspectives of the respondents. 

* State conclusions in a concise, straightforward 
manner. 

' Prepare a draft of recommendations. 



""You may wish to review the reference information on 
. assessment in,Sessions Three, Four, and Five. 



4^ 
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SESSION ELEVEN 
REFERENCE INFORMATION 



t 

Use of an Oilitside Evaluation Consultant 



When deciding who should be rcspooiible for implementing the evaluation design for a program or project, consider the 
following possibilities: 



ln-hou$e 
Person 



Possible Advantages 
1. Cost may be lower. 



t ojay^e 



2. Can be involved in early planning of 
evaluation as an ongoing activity. 



3. May have awaro^^ss^and und^P^nding 
of program goals!^ \ u 



Possible Disadvantages 
1 . Lack of objectivity. 



2. May not have skills needed for instru- 
ment design or statistical analysis. 

3. May not have credibility with superiors 
or peers. 



■ V J 

4. Has kncfwiedge of how program functions. 4. Evaluation may be one of many 

responsibilities. 



Outside 
Evaluation 



1. Should have broad range of skills in 



nge OF 

' instrument design, evaluation design, and 
report writing. 



2. Must have credibility. 



1 . May not have awareness and under- 
standing of program goals. 



2. May not have knowledge of program 
functions. ^^ 



3. Can maintain neutrality or objectivity. 



( 4. Could consult in-house person on 
evaluation. ' . 



3. ^ay not be involved in early planning of 
evaluation. 



4. Cost may be higher. 
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SESSION ELEVEN 
REFERENCE INFORMATION 



Objectivity/Planning Suggestions 
for Evaluation Methods 



Objectivity 



odiv 



Probably there Is no such thing as totally objective 
evaluation. Bven the use of an outside evaluator docs 
not guarantiee absolute objectivity. All evaluators bring 
their own sets of biases about how to treat evaluation 
daU. The following steps are Suggestions that may 
help.increa$e the objectivity of^the evaluation effort 
regardless of who carries out the evaluation. 

• Evaluators should review their own attitudes 
and biases which might influence their inter- 
pretation of the evaluation data. 

- This isjjartfcularly important for persons 
who will be evaluating programs in the 
ajcoholisnr/field. 



Whenever possible, the appropriateness of data- 
gathering evaluation instruments should be 
examined by others involved in planning bie 
program. 

An overview of the program should be main- 
tained and reviewed periodically so that all of 
the program elements ar^ seen as part of an 
integrated system. 

- It is surprisin|[y easy-even when striving 
for objefi>ivity-to become so engrossed in 
one program element that the total picture 
is obscured. 

The focus of evaluation efforts must be on im- 
portant details rather than inconsequential ones. 



Planning Suggestions 
for Evaluation Methods 

The effectiveness of Ihe evaluation of any proposed pro- 
gram can be enhanced by observing the following sugges- 
tions when planning the evaluation methods to be used. 

• The purposes of the evaluation efforts as well as 
how the results of the evaluatior^effort will be 
used should be made explicit to everyone in- 
volved in the program. 

• As the details of the program are worked' out, 
'th^ evaluation consultant should be sure to 
include: 



— the design and construction of any data col- 
Wction instruments to be used; 

— instructions that clarify and describe the - 
specific procedures to be followed; and 

— a schedule for the observations, surveys, inter- 
views, or tests to be administered. 



• Individuals who are to use any b f t h e d ata ^ 

gathering instruments should be trained in the 
principles and techniques of evaluation relevant 
lo the particular method or instrument. 

After the decision has been 

made to employ an outside evaluation 

consultant what must be done? 



Two necessary 
sonnel are: 



Cinctions for the program per- 



— to maK?tertain that the program is prepared 
for evaluation (e.g., apply the Evaluation 
Readiness Checklist); and 

— to brief or orient the evaluation consultant. 
• Preliminary activities for doing these incltf^: 

— making specific and detailed listings of the 
program elements to be evaluated; 

— specification of program complexity to be 
used in defining the area(s) of expertise 
needed by the evaluation; and * ' ' 

— briefing of key program personnel to ensure 
their cooperation in evaluation activities. 

What information will an evaluation 
consultant need from program personnel? 

• To provide thorough and effective evaluation 
^assistance, the evaluation specialist needs: 

— a clear definition of what is to be eyaluated, 
including a review ofihe proposed evalua- 
tion methodologies, approaches, etc.; 

— a set of tim^ines for deliverable items such 
as instruments, .reports, etc.; and 

— information about areas in which conflicts; 
of interest might e;?ist between some pro- - 
gram personnel and the evaluation 

.objectives. 



What other matters must program 
personnel attend to? 



reports, the exchange of comments, criti- 
cisms, and recommendations); 



• After evaluation activities are underway, the 

person(s) responsible for directing the program r 
\ should: ' 

* — be sure that communication channels are 
established and used (e.g., periodic progress 



^ — make certain that all evaluation expenditures 
are cleared with the proper authorities; and 



J 



— help the evaluation consultant resolve what- 
ever unanticipated problems may arise. 



SESSION NOTES: 
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Conr^letion of 
Preliitilnary Plan for 
Back4lome Problem 



Session Xfl 



Synppsb: After a brief summarizing discussion of the 
'^fanning prpccss, participants will work individually on 
their preliminary plans.for their back home problems, 
with a final opportunity to ask for assistance from the 
trainers. They will then discuss their planning problems 
as a group and identify a helping network for future 
contacts. 



Objcctivcr Participants will: ^ ' 

• complete their preliminary or partial plans for 
attackihg their back home problems. 



Reference Information: Time-Phased 
Action Plan Reminders 
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SESSION TWELVE^ . 
REFERENCE-INFORMATION — 



Time-Phased Action Plan Reminders 



NOTE: It will be-helpful to use consistently the check- 
lists and techniques prpvided in the training 
pro^m as you build your planning skills, so 
thatn^'mportant step or detail Is overlooked. 
' It will also be advanta^ous to develop a review 
relationship with someone ir^your agency v^o 
can crijtlqueyour efforts in the way that your 
^dyad partner did during training. The following^ 
"Reminders provide only an outline of what ii-ttS^^ 
, be dope in developing a time-phased action plan^ 

Stating the Problem and the Program Goal(s) • 

• State the problem selected for action, and the 

i^rogr'anfi goals developed to address itj 

. • - ' * ' ^ •, ' 

-J: This helps to keep the starting point afuf gen- 
eral direction(s) in mind as details receive , ■ 
more^and mbre attention. , >i 

- v ■ * r^t — • • T : . 

Stating ObjectiveS'fbr Each Program Goal ' 

; • •".Knowing the speclfwiities of the objectives^iS . , 
absolutely^essential Jc^'designl^the prog^ 
implementing, and^evaluating'it . ' . 
• • • ■ ■ 

• Limit work on- writing each objective to 10 ^ . 
minutes, to avoid getting bogged down in inde- ' " 
cision or top mapy details. 

— Check specifically forlthe four characteristics 
of a program objective: identification of tar-' . 
get group, the intended result rpeasurable 

* ' terms, and time reference. 

♦ Rewrite as needed.^-- . 

• B^Tcalistic about j'qiiching the goal-even at 
thiy point. ./-^ 

ink smaU and precise rather than grand and 
g/ol?al. 

. • l^*wFitte objectives if subsequent planning ac- 
tivities reveal the need to do so, e.g., 

— Increase time. 

— Reduce the number of events, clients, etc. 
Brainstorming Possible Strategies ■ \ ' ■ 

\ • Work with yoiur planning group to brainstorm 
'yf- possible strategies for each objective. 
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— Limit brainstorming activity on each objec- 
tive to three minutes. 

Make no judgments at this point 

r 

• Apply quality criteria to each Strategy listed: 

— completeness; 
. . - flexibility; 

— simplicity; 

— explicitness. • ! • 

• Discard or rephrase unacceptable strategies for * 
each ol^ctive. 

Strategy Selection 

• For all acceptable slr^tegies for e(7c/7 objective: 

— list direct and indirect consequences; ^ , 

— determine negative and P9sitive influences; 

— weight the importance of the influences. 

^ • Select the most promising strategyls) for each 
objective. • ' 

Commuriity Resource Inventory 

V • ^or each strategy selected:^ ' * 

^ - Jdentify the basic resources needed; Ijlg,, 
! * ^ facilities, equipment, supplies, persomiel, 
money, other; and ^ / ' 

**'■', 

— determine whether they are on hand, to be 
mobilized, or not Available. 

Activity Identification and Organization . 

• For each strategy identify the major activities 
# required to carry it out 

' - List the activities as they conrie io mind. 

— When no mor? activities come to mind, num- 
^ "-ber them in order of probable occurrence 

— ma4cing certain that each is a separate activity^ 
rather than a portion of another activity. 

Identification and Organization 
of Tasks and "Doers'' 

..M 

• ^For each maj6r"^ei«fity identify exactly what 
must be done to complete each, activity. 
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, Session TWELVE 

-REFERENCE INFORMATION 



- List the tasks as they are thought of, 

- When no more tasks can be called to mind, 
number them ad^rding to their necessary or 
probable occurrence iri completing the 
activity, , 

• Identif/ who will be responsible for doir^^cb 
task. 

• Rcj^cw the activities and tasks listed to see 
whether rtiodificatlons should be made in the 
community resources inventory. 

^ If necessary, modify the inventory. 



TinjtPhascd Artlon Plan 

• Using the training program materials and ex- • 
periericcs as starting polr\ts, design a format to - 

• show when each task Is td begin and end, 

• Consider 

, - whether your time-phased action pbrt or* 
some part of It should display.weeks or days 
^ rather than months; and 

- whether some complicated task should be 
broken do>yn into its subtasks for adequate) 
allocation of time and "doers." 
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Appendix A: 
Annotated' Bibltggraphy 



General References: Books 

Cros5> Jay N. Guide fofAe Community Control of Alco- 
holism. New Vork: American Publjc Health 
Association, 1968. (128 pages) 

Intended to aid the professional health worker at 
theJocaJ level in developing a community alco- 
hotism program. Principles of program develop- 
ment arc discussed, rather thao specific services 
and activities. The fir^ two sections deal with 
social, physiological, apd psychological aspects 
of drinking and proV<de a generaJ discussion of the . 
problem of alcoholism. Part Three, "Alcoholism' 
Progpm Development," presents planning princi- 
ples in terms of organizational considerations, 
goals and objectives, resources and services^tDm- 
munity perspective, *roles of agencies and organi- 
- zations, prevention planning, financing, staffing, 
and program coiViponents. A brief bibliography 
is Included. > . ' , 

Harp^er, Ernest B., and Dunham, Arthur, eds. Community 
Organisation In Action. New York: Association 
' Press, 1959. (532 pages) 



Design(6^ primarily for students of social work, 
this coM^^tion of^eadings includes experiences, 
methods and principles that can be useful to any^ 
community planner. Sclcctions^on group be- 
havior, groupirdynam'ics,. and c{(rA)rt|]Uees on con- 
flict and integration, community structure and 



relationships, and the role of national voluntary 
organizations in community programming are 
* included. Pact Three, "Community Organization 
in Practice," which includes articles on general 
methods, feet finding] planning, conferences and* 
committees, education, interpretation and public 
relations, fund raising, and social Action and re- 
cording may be of the most interest to the com- 
munity programmer. 

Kahn, Alfred J. Studies In Social Policy and Planning. ^ 
New York: Russell Sage Foundation, 1969. ' 
(326 pages) 

In this companion volume to Theory and Practice 
of Social Planning, the author isparticularly con- 
cerned with ^'the demonstration through use of a 
number of critical planning concepts often dis- 
cussed oqly in the abstract." Problems discussed 
incluiie the "War Against Poverty," juvenile prob- 

• lems, income security^ city planning^y community 
psychiatry, and delivery of social s^ice at a local 

'level. Alcohol pr6blemsand programs arenol.^ 
spficificaJly discussed. 

Kahn, Alfred J. Theory and Practice of Social Planning 
New York: Russell Sage Foundation, 3969. (348 
pages)' 

Presented a^ a model for "how to think about 
plannmg issues," this book isa broad^development 
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Impolicy choice and programming in the light of 
facts, projections and applications of values.*' The 
planning process is presented in tenms of definition 
of ihe planning task, policy formulation, program- 
ming, and evaluation and feedback. Within this 
framework, all of the broad social planning issues « 
are discijssed, and the dynamic nature of the plan- 
ning process is emphasized. The three chapters on 
progranwtng may be the most useful. Topics 
compri^ general considerations, budgeting and 
cost effectiveness, and programming problems in 
social service delivery. 

^aUQQ^ Institute on Alcohol Abuse and')\lcoholism. 
uS^ping Community Services^ for Alcoholics: 
Some Beginning Principles. RockwlWe: Maryland: 
NIAAA (DHEW), 1971. For sale by the Superin- 
tendent of Documents, U.S. Government Printing 
Office, Washington, D.C. 20402, ^HEW.PuljJica- 
tion No.' (ADM) 75-175. Price: ^| cents. (39/ • 
pages) ' " ^ ^ ^ 

Proposes the formation of a network ofjcommunity 
services for alcoholics and their families constructed 
primarily of existing scjvicc reso\Jrccs within the 
community, with^a recognition' of the likeness of 
alcoholism to other health and social problems. 
The nature of the problem of alcoholism isdis-^ 
cussed briefly, in terms of the alcoholic, public atti- 
tudes towards alcoholism, treatment^pproaches,. 
and,the n^cd for comprehensive community ser- 
vices. Elements of effective service delivery and 
guidelihes for organizing community resources are 
given, and, the importance of evaluation to program 
development is discussed. A brief annotated bibli- 
ography is included. 

Robbins, David. Comprehensive H&wth Planning: Selec- 
tive Readings. New Yorkr Health Frisurance Insti- 
tute, 1969. (48 pages) 



An annotated bibliography organized under the 
follpv^ing topics: 

• Cofhprehensive community planning 

• Planning theory and techniques 

• Health services planning 
Health manpower planning 
Environmental health planning 



Warren, Ronald Lesri^. Studying, Your Community. New 
* York: Russell Sage Foundation, 195^ (362 pages) 

A cor^prehensive guide to studying almost all as- 
pects df^^commu^iity. Areas discussed include 
community. background and setting;. economic life; ' 
government) p^l^s; law ehfor^ement;'Communlty» 



Iannijl5g; housirtg; recreation; rejigious activities; 
sociaf insurance and pulj^lic assistance; aids to family 
Ihdng and child welfare; health; provisions for spe- 
cial groups; communication; intergroup relation- 
vShips; associations and community organizations. 
The final chapters are devoted to discussion of or* 
ganizing and.conducting a community survey and 
a sAmary of important aspects of the community 
tave considered in such an endeavor. 

Wynne, Ronald D., et al. A Guide to Community Action 
for Alcoholism Services. Final report to the Na- 
tional Institute on Alcohol Abuse and Alcoholism, 
September 1 975.* (1 90ages plus appendices) 

Intended for individuals recently involved with the 
alcoholism problem in tneir communities and for 
those in a direct service role who want to expand 
to address larger issues and problems. Im authors 
.^^ ' distin|uish between "comipunity organization" and 
' ^'soc^^-j^l^anning," which is treated in a companion 
volume.; Part I provides an introduction, historical 
overview,'and discussion of corhmunity response 
. to ofg^inizations for alcoholism services, organizer 
role, community mobilization, and common prob- 
lems an(tsuggested>solutions in cornmunity brgani- 
^ ' zation. Part II cCHnprises several case studies'and 
^Part 111^ is ^"workbook" and annotated 
bibliography. 

Wynne, Ronald D., et aj. The "State of the Art*' in 
Community Planning for Alcoholism Services. 
Final report to National Institute on Alcohol 
Abuse and Alcoholism, September 1975.* (321 
. pages) 

. A review of the Issues that confront social planners 
in the alcohol field, a "look at the types of formal 
documents available, at who develops them, and 
what methods they use to achieve their objectives." 
In Part I, Section I describes the structure of the 
planning effort and includes a summary of training 
available for alcoholism planners. Section II 
describes the pjanning prQcess,'from needs assess- 
ment to evaluation. - Section III discusses six major 
issues ^nd trends in the alcoholism field of concern ^ 
to planners. Part 1 1 presents four case studies to 
demonstrate a/^umber of planning approaches. 
Part I II is a mbliography, including annotations of 
80 major references. 



*A limited number of reprijts are available from Wynne 
& Associates, 3915 Livingston St., N.W., Washington,. 
D.C. 20015. 
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General References: Periodicals 

BcigcJ, A.; Hunter, E.;Tamenn, j.;Chapin^E.;and 
Lowcry, M. Planrting for the Development of 
Comprehensive Alcoholism Services: I: The 
Prevalence Survey. American Journal of Psy- 
chht^U 131 (1974) 1112-16. 

Thelij¥iors emphasize the nertJ for prevalence 
data in tnfe specific community when planning 
^ ; a^ comprehensive comrtujnity alcoholism program 
and describe a short-term, low-cost survey method^ 
together with examples of how the data obtained 
can be used in program planning. 

^eigel, A.; McCabe, T.;Tamerin^ J.; Lowery, M.; Chapin, 
E.; and Hunter, E. Planning for the Development * 
of Comprehensive Alcoholism Services: II: As- / 
sessing Community Awareness and Attitudes. ^ 
^^^merlcan Journal of P&ychiatry. 131 (1974) 
1116-21../ 

The authors suggest that the following dimensions * 
need to be assessed in the development of an effec- 
tive community education and treatnient program; 

(1 ) attitudes toward alcohol use and ^buse; 

(2) drinkmg habits; (3) awareness of available 
resources for alcoholics^ (4) extent of personal 
drinking problems; and (5) coniparative percep- 
tions of alcohol abuse in different ethnic groups. 
The procedure they have used to make these as- 
■sessments is described arid examples of how data 
^thered can be used in the planning process are. 
presented. 

Beigel, Allan. Planning for the Development of Compre- 
hensive Community Alcoholism Services: Organi- 
zational Approaches. Journal of Drug Issues. 4 
(1974) 142-48. / 

This paper^ythjrd in a series on alcoholism plan- 
ning, presents advantages and disadvantages of 
four different approaches to organization of com- . 
prehensive community-based alcoholism services: 
(1) the/'governmental approach"; (2) the "single 
community agency approach"; (3) the "consor- 
tium approach"; and (4) the "for profit approach.'^ 
A discussion of "certain substantive issues that 
transcend any and all of these organizational ap- 
proach es'^ncludes the composition of community 
boards, an effective combination of traditional 
versus Tibntraditional treatment approaches; ade- 
quate program planning; arrangements for conti- 
j nufty of care; and stability of funding resources. 



Holder, L., and Denistpn, O. A De«sion Making Ap- 
proach to Comprehensive Health Planning, Pub- 
lic Health Reports. 83 (1968)559-68 



* The authors offer a definition of planning, suggest 
ways of looking at health planning objectives, 
attempt to differentiite among forms and methods 
employed in health planning, and surpmarize some 
of their experiences in wofking with 21 communi- 
ties throughout the Nation through the National 
Coltimission on Community Services' Conwiunity 
♦ Action Studies Project (CASP). Several themes 
that became apparent from the CASP study are 
discussed: 

' ^ 1 , No single agency or group has domain overthe 
health needs of a community. 

2. Health-is a total community affair. 

3. Local, State, and national bodies must work 

> as "partners in progress." ' ' 

'4. A coordinated approach transcending tradi- 
tional geographic and political boundaries may 
be needed. 

5. Regional action planning is a prerequisite to 
development of community health services. 

6. The health issue is intertwined with other com- 
munity issues (economic development, educa- 

*tion, transportation, etc.). j i 

Selig, Andrew L. Program Planning Evaluation and the 
Problem of Alcoholism. American Journal of 
Public Health. 65 (t975) 72-75. 

Briefly describes eight steps or functions in the 
/program planning process: (1 ) value orientation; 
(2) problenri identification; (3) goal setting; 
(4) goal measuring criteria; (5) program planning; 
(6) program implementation; (7) assessment; and 
' (8) feedback- A case study is discussed briefly to 
illustrate the application of the first five steps. 

Evaluation References: Books 

Abrams, L. Annette; Garfield, Emily F.;and Swjsher, 
Jofin D. Accountability In Drug Education: A 
Model for Evaluation. Washington, D.C; Drug 
Abuse Council, 1973. * 

First in a -series of handbooks providing practiclf 
methodological guidance for drug program pianners^*^/ 
and administrators. The manual gives step-by-step 
explanations of the processes involved in planning 
and 'assessing program effectiveness, keyed to the 
ftader's lev^of involvement. 



Babbie, Earl R. Survey Research Methods. Belmont, 
CaJifornia: Wadsworth Publishing Company, Inc., 
1973. 



j: 



^ A basic text for those interest in designing and 
using a survey as part of their evaluation effort 
A practical text that combln^the theory behind 
survey research with example/of h6w.to design 

: the survey instrument, collect and analyze the 
. data, as well as hoW to report the findings. 



SkxJL, B. 



The evaluation of primary prevention pro 
grams. In: Comprehensive Mental Health: The 
Challenge of Evjiluiatlon. Roberts, Leigh M., etal., 
(eds.). Madison: University of Wisconsin Press/ 
1968 

^ ' Good suggestions for evaluating; inci udes caveats 
and plt^lls. 

Campbell, Donald, and Stanley, Julian. Experimental 
and Quasi-Experimental Designs for Rksearch, 
Chicago: Rand McNally, 1963. 

A pioneering work and basic text for evaluators 
and researchers* ' 

ChaboUr, Kent J., and Lad, Lawrence J. Evaluation 
Guidelines for Training Programs, East Lansing: 
Michigan State University. 1974. 

The table of contents of this comprehensive work 
is structured in such a way so as to guide the 




to those sections which pertain to the partic 
evaluation questions the user WaiTts answers. 
The text covers such areas as why and what to ^ 
cvaluate,'the criteria for effective evajuation, re- 
r -H^*^^^ design, evaiu^^'on measures, and data 
^ analyses. , 

Available from School of Public and Environ- 
mental Affairs, Indiana University, 400 East 7th 
Street, Room 313, Bloomington, Indiana 47401. 
$10.00. 

Harnett, Carolyn. Drug program evaluation— a primer. 
' Gr^^oots Supplement Madison, Wisconsin: 
STASH Press, 1974. 

/ An outline of methods of evaluation. Covers the 
-^.* reasons for doing an evaluation, when, how, and ^- 
who should evaluate. 

National Drug Abuse Center for Training and Resource 
Development. Fundamentals of Program Evalua- 
tion: Trainee's Resource /Manual Arlington, 
Virginia: National Drug Abuse Center for Train- 
ing and Resource Development, 1977. 



The manual allows the reader to work through a 
. basic systems approach to p\ogram evaluation. 
The manual is divided into rnqctules each of which 
focuses on one cpmponent oT th^^tem such as 
goal statements, progl^ objectives, and evaluation 
design'. By completing a series'bf worksheets for . 
each module, the reader applies the information 
presented to her or her own program. Extensive 
reference materials on evaluation are provided 
/ in the following areas: ;rai4'ng, treatment, P''e-^j^^ 
ventiorlj'imd management information systems. 

> Available from the publisher at 1901 North Moore 
Street, Arlington, Virginia^ 22209. • * " 

Popham, W. James. Educational Evaluaiion. Englewood 

Cliffs, N.J. : Prentice-Hall, 1975. * 
« 

While focusing on education, the evaluation tech- 
niques discussed are applicable to a wide variety of 
sociatTtttfon programs. The author concisely and 
clearJypresents the major evaluation issu^, con- 
ceptsV and techniques as^they have developed over 
the past ten years. Numerous examples make this 

a high/y usable book« 

( ■ ■ ' 

Rossi, Peter and Williams, *Walter, (eds.). Evaluating 
SociaJJ^ograms: Theory Practice and Politics. : 
NewSwk: Seminar Press, 1972. - 

The material is organized under the three headings 
listed in the title. The book should be of particu- 
lar interest to program directors or managers who 
may be setting up or participating in a large scale 
evaluation research project. 

Tripodi, Tony; Fellin, . Phillip; and Epstein, Irwin. Social ^ 
Program Evaluation Guidelines for Health, Educa- 
tion, and Welfare Administrators, Itasca, Illinois: 
F. E. Peacock Publishers, Inc., 1971." 

Good for beginners. Very clear and concise. 

Weiss, Carol H.4 Evaluation Research /Methods for Assess- 
ing Program Effectiveness. Englewood Cliffs, N.J.: . 
Prentice-Hall, 1972. 

Presents a new methodological approach to evalua- 
, tive research that increases the testability of as- 
sumptions that primary prevention is cost- 
effective. 

^Zusman, Jack, and Wurster, Cecil R. (eds.). P/rbgram 
Evaluation: Alcohol, Drug Abuse, and Mental 
Health Services. Lexington, Massachusetts: D.C. 
Heath and Company, 1975. j . / 
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Trainer 
Rec|utrenicntS! 



Content: 



Methodology: 
Time 

Requirements: 



7 



[e of program development 
irffng sklUs rc^qiiired include 



Both training skills and first hand experience with or knowl 
alcohol field are requisites for conduaing tt}is course. The 1 

pertise in settlng.up and managing training events arid skill in^anaging group dynamics ai 
moderating group dtscusston.^ Experience in the development of ajcphbl service programs 
important in leading group discussions. It is recommended that two Irajoers cooperate in 
presenting this course, perhaps combining the aboH^ mentioned ' 



Session Oije: 
Session Two: 
Session Three: 
Session Four: 
Session Five: 
Session Six: 
Sessiort Seven: 
Session Eight: 
Session Nine: 
Session Ten: 
Session Eleven: 
Session Twelve 





Introduction and Welcome 
Planning and Community Involvemen 
Assessment: Suting the Problempf- 
Assessment: Collecting Data About 
Assessment: Analyzing the Data for D^^ 
Program Design : Setting Goals /f-'^^^'i^J^^. 
Program D/ssign: Specification of Objecjiv^^?;" '^'^^'^ 
Prt)gram Design : Choosing a Strategy . " ^! 
Program Design: Time-Phased Action P'an i'lT^^^c, 
Implementation: Program Managementand|c6pra^ 
Program Evaluation ' — ff 




Completion of Preliminary Plan for Bade fld^Problem 

Small large group discussions, individual and small group work, trainer pt-esentatibnS, 
individual reading. 



Approximately 30 hours plus breaksI-Sessions vary in length from about 1 to 2 1 /2 hours. 
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